DOCUMENT RESUME 



ED 243 187 

AUTHOR. 
TITLE 



INSTITUTION 

SPONS AGENCY 
PUB DATE 
CONTRACT . 
NOTE , 



EA 016 679 



$JBB TYPE 
EDRS PRICE 



DESCRIPTOR^ 



Wholeben, Brent E.; Sullivan, John M. 

Multiple Alternatives Modeling -in Determining/Fiscal 

Roll-Backs during Educational Funding Crises. Interim 

Draft. Paper and Report Series No. 70. 

Northwest Regional Educational Lab., Portland, OR. 

Research on Evaluation Program. j , 

National Inst, of Education (ED), Washington, DC. 

Mar 82 V 

400-80-0105 * 

156p. 

Reports - Research/Technicail (143) ^ 



IDENTIFIERS 



ABSTRACT 



< "^*\MF01/PC07 Plus Postage. . 

♦Budgeting; *Educational Finance; Elementary 
Secondary Education; Evaluation Methods; 
Expenditures; *Finance Reform; *Financial Policy; 
Fiscal Capacity; *Mafhematical Models; Multivariate 
nalysis; Resource Allocation; *Retrenchmen^; . \ r 
phematic Studies'; School Accounting 
ul^iple Alternatives Analysis 




This report provjides an extensive discussion of the 
use of criterion referenced, mathematical jpodeling procedures to 
determine which budget reductions, minimize reduction in the quality 
of educational programs. Part I, "Evaluation of Potential Budgeting 
.Roll-backs under Educational Fiscal Crisis , " explains the basic 
design of multiple alternatives analysis and the context for its use. 
Chapters include (1) philosophical foundation for fiscal modeling, 

(2) program budgeting for aln allocation/deallocation fiscal strategy, 

(3) traditional modeling via. cost analytical des^^ (4) operations 
research and the evaluation of feasible alternative^, and (5) 
simulation modeling within a cViter ion-impact design. Included also 
is a background to the field 'investigation and outline of the 
technical report.. Part II, "Multiple Alternatives Analysis as a 
Mathematical Decisioning [sic] Model," provides ttie technical "and 
mathematical details of the analysis^ including both construction and 
validation. Part J 1 1, -"Field Application of the Rolbak Model," 
contains an extensive sampling of. the use of these procedures in 
reducing a budget within a local school district, including chapters 
on,(l) construction of the database, (2) initial T-normal % 
transformations, (3) formulation of the rolbak mathematical model, 

(4) search for regional feasibility as a benchmark, (5) cyclic 
optimization of the restricted model, (6) cyclic optimization of the 
relaxed model, and (7) comparison of the restricted and relaxed 
"decisioning" models. Part IV summarizes the Multiple Alternatives 
Model and assesses its future. (TE) 

V 



**** ** ********* ********************* *********************************** 

* Reproductions supplied by EDRS are the best that can be made * 

* from the original document. * 
*********************************** ********************** *************** 



9 

ERLC 



' INTERIM DRAFT 

Do not' cite or t^ugte without 
authors^ permission. 

i 

Authors* welcome reactions and 
suggestions 



r < 



- ^ 



r* 



I 



1 No. 70 MULTIPLE ALTERNATIVES MODELING IN / ' 
DETERMINING FISCAL ROLL-BACKS ... . ' * 
DURING EDUCATIONAL FUNDING CRISES 



BRENT E. WHOLEBEN 
JOHN M. SULLIVAN 



* 

University of Washington 

Sumner, Washington, School District 

(respectively) " 



/ March 1982 



Nick I*. Smith, 'Director • ;\ 
Research on Evaluation program J 
Northwest Regional. Educational Laboratory f 
3p0 S. W. Sixth Avenue, Portland, Oregon ,97^04 



Published by the Northwest Regipnaij. Educational Laboratory/ a private 
nonprofit corporation. The~ work upon which this publication is based 
was performed, jiri pj^rt, -pursuant to, Contract No. 400-80-0105 of the 
National Instit^Sof Education.. Ijt does not, ' however 4 necessarily 
reflect the views of that agency. , 

The information presented lh ^this publication does not necessarily 
reflect the /opinions of the Northwest .Regional Educational Laboratory 
and no endorsement should be inferred. 



! • -* ' ^ PREFACE ~ , r ' 

. • • * • . - ' ' i 

The Research on Evaluation Progrpi is a Northwest "Regional 
Educational Laforatory prdjeot^of research/ development, testing, 
ana training designed to create .new evaluation methodologies for 
use in education. This document ^.s.orie of a 'series of papers and 
reports produced by program staff , 'visiting scholars, adjunct 
scholars, and project collaborators—all m^irtB&ars of a cooperative 
network of colleague^ working on the development o£ 'new 

methodologies. ' \ . 1 f . 

1 y . ■ ■ 

How can. one' determine the proper mix of educational programs>to 
deceive .reduced* jfunding when 'budget cutbacks' are necessary? This ' 
.report providesf; an extensive discussion of the us^of criterion 
.referenced, mathematical modeling procedures to determine which 
budget r^uctibni^ redWe the quality of educational 

programs. Part i 'of this report s explains tha basic design of 
multiple alternatives analysis an<} the, content for its use;, 
Part II provides the. technical and mathematical details of the 
analysis; aiyi Part III contains an extensive example of the use 
of these procedures in reducing a budget within a' local school 
district. This report describes a highly technical but workable 
solution to the difficult problem-vpf reducing school budgets./ 

* v \ ' -Nick L. Smith, Editor , 

Paper and Report Series ' 
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INTRODUCTION TO. JHE 'SURVEY ,- 

' , * • • o . ' ° • • • 

. -r ' / < - 

• . v>* ■ . ■ ; . • 

.^.Educational decision-making has evolved i'nto a most complex 
and demanding process. What was once" a realm almost completely 
associated with experience arid '"arm-chair reckoning 1 , administra- 
tive perogative now demands a highly .informed,' structural and 
of tell equally complex approach* to' problem .r^medi ation. Educators 
and educational abministrators 'in particular, have over the past. 
s^ve^aV years" ch-oseh to ignore the need to develop more sophisti- 

.cated decision-making strategies; Now however, tjhe direction is . 
clear. Problems representative of desegregation^ declining 
enrollment, school closures; distinct consolidation, ,attend*ance : 
boundary redisricting, P*;L, 94.-14? compliance and (education's ; 
perennial nemesis) reduced .funding -al location— taunt every - 
educational system, from small school districts through state , and 
federal offices. — . • 

Many of today's complex educational issues can b'e translated 
into what has become known as the . "multiple-alternatives problem" 
(WhoJeBen, 1980a)V for example, irt 'evaluating several elementary 
school sites/for closure, the question is not, "whether site-A 
versus site-Ef is closed" but rather how many . sites and which ones 
'.•should be deactivated in order to f ulf i 11 : (l), the N objectiv6s of 
the^required decision (what we will come to cjall 'constraints.') 
and, (£) the npeds .of the district * involved (which we will soon 
learn is the 1 conditional Vector \) . ** Likewise in^ developing 
sophisticated curricular systems^ the specialist discovers that, 
many alternative . jnstructional^acti vities exist which could be 
implemented in fulfillment of the requirements for: a-priori 
stated instructional xDb'jective? (themselves related^to desjred 
concept- 1 earn i ng ) . Obvious resource factors such as time, cost 
and the varying o^rtise of available /personnel, mil it-ate" against 



"the otherwise optimal solution of "doing everything". However, 
the actual problem is much more subtle. For example, how related 
are activities 'A' and MJ' in regard to satisfying some aspect of 
objective A? Is A more costly yet more effective,- while B is 
less costly but ndt as* effective? Are both A and B similarly .y 

lcient in terms -of time required for presentation. and/or 
conclus-ion of the activity(s) itself? And even more subtle, does 
the selection of A in terms of some stated objective affect the 
*ictiv,ities that may be chosen for another objective, related to a 
different though required. concept? 

Thus, the multiple alternatives approach to modeling various 
complex situations in the educational sector is itself a complex 
milieu; with the purpose of designing a thorough, highly- 
structural decis^ning model to adequately assist the educational 
decision-maker in understanding, analyzing and decisioning (sic) 
the multiple alternatives' problems faced today. 

The treatise contained within this present paper concerns the 
expositon and multiple-alternatives interpretation of another 
complex and highly volati problem in education, to wit: 

- . " Given a situation of reduced funding allocation (and 
therefore required reduced expenditure) across educational 
programs, how many programs will be funded and which ones; 
. subject to the budget being balanced and the goals of the 
school (district) maximized while (of course) minimizing 
any perceivable negative impact upon the system as a whole. 

Th>s is the context of fiscal roll-backs ; that is, "rolling-back" 
program execution due to some level of reduced expenditure 
necessitated by a funding crisis, (levy failure, reduced state 

2 



13 



and/or federal matching support, o*, the irrational requirement to 
transfer- monies from one account into another (program to 
program) because one program is P. L. -mandated. (public' law), while 
the ofher is not (though required nonetheless)." 

This paper addresses (and hopefully satisfies) three main 
goals. First , the reader will gain an understanding of the 
budgeting'roll-back (alternatives) situation under fiscal crisis. 
Contained within this intended understanding will be the investi- 
gation of- "allocation versus de-allocation" as a fiscally- 
oriented decision-making strategy; and the relevance which 
traditional cost/benefit modeling provides to the interpretation 
of a multiple-alternatives framework. * \ 



Secondly , the reader will be introduced to a relatively 
complete (albeit brief but hopefully not cryptic) discussion of 
multiple alternatives analysis as a decisioningmodel . 
' Principles from the generation of collectively-exhaustive deci- 
sioning alternatives to the development of system-constraints 
upon that decisioninb will be presented and illustrated. 
Suggestions for validating the constructed model will be 
provided; and the limitations of the model itself, discussed. 

The third and finalgoal of this treatise is to present the 
detailed results from a field-application of the fiscal roll-back 
decisioning model. Identification of the various mu)tiple alter- 
natives (viz., programs) discussed, the development of the 
constraints (system objectives) defined, and the construction of 
the modeling framework illustrated. Finally the impact upon the 
system of the various programs chosen for funding (or defunding) 
will be investigated via certain statistical procedures; and the 
role of the modeling constraints demonstrated in terms of the 
degree (or extent), to which the model* "modeled" the simulated 
decision-making environment. 
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A fina"! word (of caution) is required at this point for the 
reader. As discussed irfthe last Section (IV-A-l) of this paper 
(Complex Approaches to Gompl ex' Issues, pp. 138), t is 
well to understand one of the man^ (rational as well as 
realistic) biases of the .authors . 

Educational decision-making today is a tricky business, full 
of hidden agenda and unforeseen pitfalls. The respc©&-ible 
decision-maker views a complex issue as (therefore) complex; and 
does not subscribe to the overused adage, "simple solutions to 

31 ex problems should be your objective. 11 Obviously, the 
lem solver cannot attach issues by "making mountains out of 
molehills", but must nonetheless recognize each "molehill" as a 
particul ate-source of a "new mountain." 

It is not the hidden goal of the authors to convince -the 
^ reader, that the multiple -alternatives approach to certain educa- 
tional problems is the perfect solution. -However, we do very 
strongly suggest that it is certainly one of a minority of pre - 
ferred techniques which the emerging educational administrator 
must be aware of and rudiment arily understand. 



Good reading! ! 



Brent E. Wholeben, Associate Director 
Bureau of School Service and Research 
University of Washington 



John A. Sullivan, Assistant Superintendent 
Sumner School District 
Sumner, 'Washington 
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PART I 
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EVALUATION OF POTENTIAL BUDGETING ROLL-BACKS 
• UNDER EDUCATIONAL FISCAL CRISES 




INTRODUCTION 



This section explores the philosophical rationale underlying 
the modeling of fiscal alternatives in response to budgeting 
cut-backs^ ancj, provides a foundation for viewing the program 
fundi ng/al location decision as either an 'allocation 1 question ^ 
(i.e. giving to) or a 'deallocation' question (i.e. taking away) v 
To illustrate the rudiments of decision model ing, the basic . < 

trends ,of the traditional cost/benefit model are defined and 
discussed, especial ly with regard to applying multiple, competing 
criterion measures across multiple (potential) alternatives 
solutions. The 'four main criterion foci of effectiveness, - 
efficiency, satisfaction and expenditures are discussed relative 
to multiple decision evaluation; and the ideas of preference and 
trade-off (compromise) necessitated by the existence of multiple' 
criteria in competition with one another are summarized^ 
Finally, the application of operations researcC-tephniques as a 
tool for evaluating potenti al alternatives is presented for the 
reader's understanding. ) ^ 

Part I prepares the reader for the technical discussion (to 
follow in Part II) regarding the actual construction of the 
multiple alternatives mode'l (MAM), through the development of a 
MAM-orientation in a fiscal budgeting (allocation, etc.) 
situation. Thus this development is situation-specific (to 
fiscal management) and will hopefully facil itate the 
understanding of the, MAM decisiioning context. This parallel 
theoretical-application discussion will hopefully allow the more 
discerning reader to view the wide-range of appl ication(s) 
available to the multiple alternatives design. The reference 
bibliography at the conclusion of this report will allow the 
masochistically-incl ined reader the ability to read more in the 
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subject of fiscal budgeting and decision-framework for analyzing 
allocation-strategies. ^ f 



PHILOSOPHICAL FOUNDATION FOR FISCAL MODELING 



Fiscal modeling refers to the studyi ng of an environment in 
'Which some decisions are required concerning funding allocations 
and expenditure control. Practitioners assume that allocation by 
itself is an automatic interval -cpntrol for expenditure. 
Forgotten (or consciously misplaced) is the notion which goes 
beyond the question of "how much spent, totally", to the more 
provocative and accountable inquiry, "how much spent, _how (in 
which ways), and where , totally". The decisions required in- 
order to fund certain programs in lieu of other (equally 
deserving) programs necessitate that the decision-maker 
(allocator) understands what monies will be spent where , how and 
why ; and in addition the impact that such expenditure will have * 
upon the total (e.g. district) program in philosophy as a whole. 
To understand such impact (both validly and reliably) and to be 
able to make the decision(s) required, certain requirements are 
mandated. 

First, an obvious need exists to define, develop and measure 
various criterion-variables in order to.be able to compare tfiieV'; 
alternatives; and measure the impact of their funding versus 
non-funding to the system as a whole. For example, women's ath- 
letic j programs in higher education have been highly subsidized on 
some campuses by income from the men's cb'Tlegiate-varsi ty sports 
programs, and from other specially ear-marked fund's out of the 
cjfeneral student-programs administration budget. As budgeting 



cutbacks becomS a fiscal reality ih higher education, and 
increased costs Aggravate the existence of less monies; the 
women's sporty program becomes a likely candidate for 'cutback' . 
or complete deVunding (cut-off). A sample of the impact-criteria, 
required by this decisioning situation might be noted as: f 

(1) sjieasures(s) of total saving's, delineated 'into sub- 
expenditure, (object codes), so that./he worth of. each 
'savings' (or 'expenditure' ) area is'Vnowrr; k ■ 

(2) measure(s) of total impact. to the prevailing .campus phi- 
. . < . losophy of equal opportunity, • equ.ity and affirmative 

action; . and 

(3-) measure(s) of relative worth in retaining or discon- 
tinuing this program, compared to other programs 
(alternatives) which could provide equal revenue savings 
(eg. campus and grounds maintenance, security, remedial 
("bone-head") lower-division courses). 

It should be clear that two factors -are operating in any 
MAM-decision.. First, the 'need exists to maximize the positive 
impact to the -system, while minimizing any negative by-products. 
Second, there must be a near-exhaustive (though empirically > 
impossible) collection of criteria through which to measure both 
positive as well as negative impact. In reality, it becomes 
(itself) a goal of the model builder: to utilize the best 

kind(s) and most type(s) of criteria in order to validate model 

i .. . 

, results. 

Maximizing Program Goals Within -Budgetary Limitations 

Funding cutbacks' relate both to the specific form of program 
(e.g. student activities, gifted education, transportation) and 

; 7 ' - 
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to the more generic definition in which 'the collection of all ;] 
.programs becomes the 'program 1 of 9 higher order (e.g.* the same j 
district" prdgrttnjy] In-maximizing the. 'good 1 'and minimizing the 
•evil 1 , the decision-maker must be alert to which level of 
program is beings referenced. .Obviously a criterion related to 
1^he co-cur^icular portibh of a student ectivitip program, U 

"to maximize the -quality and extent of ;each 'student ' s 
participation within co-curricul ar activities,". 



may have greater weight to the SBG/ASB advisor than to the prin- 
cipal who needs a higher funding level for a ' back-to-basics' 
remedial curriculum. 

At either level, the focus is identical: 

"to maximize program goals within budgetary limitations", 

while "minimi zing the impact of any budgetary cutback decisions to 
the system as a whole. Fiscal modeling thus takes on the 
appearance of a system of compromise — that which is possible 
versus that'which is desired. By juxtapositioning maximal bene- 
fit against minimal harm, each fiscal, alternative's "weight" and 
"importance" become- readily apparent, , and available for com- 
parative evaluation. 

Partial Defunding v. Selective Deallocation 

Parallel to the discussion on-maximizing -program goals 
(desired outcomes) within established budgetary limitations is 
the economic notion of a 'break-even point'. Often times, the , 

8 



education*? -decision-maker announces a cut-back decision a 
percent (or percentage) decrease in allocations. The program ' 
chairs are advised to "do their best with less", 'often without 
reflections upon whether the resulting limits "placed upon program 
goals can be realistically achieved. At some, point (the 
'break-even point') reduced expenditure (reduced funding) results' 
in program performance occur ing below acceptable progranAgoal s; 
and thus opens a forum 'for discontinuing that program' s op^at ion 
which would then result in the savings of the total potential^ 
expenditure. The decision-maker must take into account, however, 
the potential of negative outcome to the, system; and thereby con- " 
sider an increase of funding to that particular program, with, 
commensurate decrease to another program(s). 

Clearly, this decision process is complex* Not only must all 
combinations and permutations of the programs being compared 
(multiple alternatives) be analyzed, but the system 1 impact of 
each combinatorial permutate must also be assessed across all 
criteria. (Sound! frightening, does it not?). This line of 
thought is further "aggravated by the aforementioned notion of 
"multiple funding levels" per program. Yet as' hopelessly ridicu- 
lous as it .may appear, the decision must be made — and is being 
made in every funding cycle of every district. 

^ Two avenues of approach to the allocation decision may ba 
made. First, reduced funding allocation is permis sable if ar/d " 
on1 y if the resulting redudid allocation does not "significantly" 
(or magnitudinally) lower Both specific and generic program 
goals, below some agreed-upon acceptable leveK That is, why 
fund a program that cannot fulfill its program goals at a reduced 
expenditure level? The second approach however is a more direct 
maneuver than the partial defunding approach, and can best be 
described as selective deallocation. 

. ■ . 9 =TTT— . - ■ — - . 
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Consider the various multiple aVtV n at i testa's specific^ 
programs whose collective outcomes form, ttajg-di strict 1 s generft . 
program orientation. .Further, consider\that some of the programs 
are modeled at "full-funding", some at^a "minimally-acceptable 
level 11 , and others at some dis^re^te^(5oinjl: in between. The deci- 
sion now becomes to fund j[allocate) at full or acceptable levels, 
pr not at all. 'This focus upon selective deallocation is of the 
utmost importance, in order to provide\a controller regulatory 
-accountability to the decisioning framework. 



\ 



\Funding Allocation v. Regulatory Accountability 

I 

The virtue, "better to give than /to receive" cannot be ^ 
applied to fiscal allocation cutbacks during budgeting crises. 
As was said in the preceding sub-topic, some distinguishable 
point must t^e defined\beyond which a cut-back decision automati- 
cally becomes a deallocate ("cut-back") decision. Such decision- 
making! must come from the genericwpr'ogram administrator; the 
specif ic-p^'gram chair is not likely to voluntarily off er such 
suggestions. But since it is trtie, that "it is easier to give 
than to account for", the necessity for some- form of regulatory 
accountability is obvious,. <$> 



The major concern in'lViV regard is of a volatile, political 
natur^. The decision-maker /must take initiative in determining 
the level of acceptable funding, and moreover operational ize the 
stance that at some "defined" point, the program will be deallo- 
cated instead of partially defunded. It is the opinion of the 
authors that all fiscal .yrol 1-back decisions be made under a' 
discrete deallocation pnilosophy, rather than a progressive par- 
tial d^funding scheme./ Such a structured, disciplined approach 
is more than offset 
fiscal system. 



the enhanced accountability to the modeled 
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Full Systems' Orientation To Input 



P 



A inodel 'of "a fiscal system, ass is-ting the decisionmaking 
") framework for selecting programs to be funded or defunded 

^ (rolled-back) is only as reliable as its abi.lity to simulate that 
system. Reminiscent of the days of systems,' planning, organiza- 
tional development and partictpaHveNnian-agement; a fiscal 
. . ■ system' s-model must so accurately simu.late* the original 

environment, that any influence (criterion-related)-tto the real 
system is also'inf luenti al to the fiscal'model (i.e. validly 
modeled). Furthermore, output. from the systems' model -due to 
modification of those criterion-variables explaining 
(constraining) the simulated framework, must also reflect the 
changes expected to the real . system (i .e. reljably modeled). 
Such a one-to-one correspondence between reality and simulated 
model requires a full systems' orientation to input. 



Input to any model simulation refers generally to the effect 
imposed upon the model by the criterion-variables used to' 
exemplify the real system; such criterion-referenced measures are 
known as constraints. Theajtility of full systems' constraints 
in accuracy and -consistently model ing reality is witnessed in 
three areas'.- First , the real system is controlled by the main 
and interactive" effects of input from innumerable sources, both 
internal and external to the system. In the multiple alter- 
natives context, such sources' are modeled via. the use of multiple 
competing criteria. Although certain sources may be more 
influential (i.e. weighted) than others, nevertheless no single 
input (effect) exists in isolation from the co-related effects 
(inputs)v from other sources. j '. - 



Secondly , the source of multiple criteria may itself some . 
from multiple sources throughout the system. For example, in' 
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deciding upon a certain curricula** program for implementation/a 
reasonable criterion measure woulcf be the extent of perceived 
effectiveness in instituting the designed learning change." Such 
perceived. change however might be different for each individual 
subgroup:- teachers, administrators, students and parents. . 
Although a measure of 1 learning aff ec^iveness 1 is- desirable, \ 
necessary also wills, be the modeling of .a decisioning process 
where each of four sources are, modeled independently .(though- 
simultaneously). * If the model were to use only a s.ingle 
constraint to input a composite measure of effectiveness, the " 
original variance between theffive groups would be lost; and the 
system inaccurately models the; environment surrounding the 

decision. i \ 

I . \ ■ . . 

; ' .. \ - : 

Final ly , a full system's; orientation to. input must be modeled 
so as to allow an ability to compare inputed criterion measures 
(constraints) across the alternative programs. Only then can an 
adequate "consensus 11 model be\ developed to portray these system 
sources of impact. \ , • 



PROGRAM BUDGETING FOR AN ALLOCATION/CEALLOCATION 



FISCAL STRATEGY , 



The reader wi<ll recall that a decision for allocation gr 
deallocation of funding requires a discrete budgeting-level 
framework. By discrete, we mean that if a particular "program can 
satisf actori ly .accompl ish an acceptable number of its goals iwith 
reduced funding, the specific level of reduced funding mustlbe 
identified and defined for that program. In this way, a multiple 
alternatives decisioning model for evaluating programs for fiscal 



rollback can a1s<$ assess a limited number of discrete levels of 
funding for«any particular program. Therefore, program 'A' at. .. 
full funding exhibits various measures' of performance on such ' ' 
pertinent criteria.as effectiveness and efficiency, as well as " 
expenditure level.. If it is ascertained that a certain part of. A 
could be omitted from program implementation without signifi-^ .' 
cantly compromising A's worth, . the\i it is reasonable to evaluate 
'AX! along with A'as two entirely separate feasible alternatives. 
That is, 'AX' will also exhibit its own measures of effectiveness 
and efficiency, with a reduced criterion, measure for .required : 
expenditure level. . I J • 

A note of caution and clarification Js necessary here. The' 
authors, accepting the discrete level of funding in modeling 
funding differences, thereby reject the closely related idea of 
partial funding vfra percent reduction. It is impossible to 
ascertain the effect upon' a program of an intended 12 percent cut 
in allocation, unless the dollars associated with the 12 percent 
are identified specifically within the program. The act of 
"divoting-up" (sic) the reduction across all shares equally is 
both unreasonable and irrational (but we choose not to overstate 
our case). ' 



Bui Wing' the Fiscal Program System 

The decisioning framework surrounding funding levels and 
revenue allocation has often 'traditional ly been related to the 
concept of system-building. Under thi,s paradigm, no pn/grams 
exfst a' priori, and therefore all potential programs compete 
(though unequally) for some proration of the total avafTfble ^ 
budget. Education became very enamoured with this', concept of 
budgeting, referred to as zero-base budgeting; and many units 
used the concept during the early 1970' s. 



The philosophical elegance of a 'zero-base 1 model is 
interesting, if not intoxicating: requiring -each" program to. revi- 
sit its 'roots' and thus 'stand' the challenge 'from- other com- ' 
petitive programs as they support their -claims- for even 
increasing levels of projected expenditure. Others believe that* 
the elegance of" the model epds with tfie statement of Its 
philosof 



Selecting programs' for funding (th^t;is, system bQilding) can 
also be viewed as an assessment procedure for evaluating certain 
alternative programs to be added to 'an already on-going- 4 system, 
and thereby provid^sritoe degree 'of enhancement to the system's 
mission. Under funding crises however, the question is ... 
(normally)..: what do.. we cut?; not , what do we add? For this 
reason, the modeling ;df a fiscal roll-back • decisn on-making pro- 
cess can easily assume the operational characteristics of the 
zero-b^e framework; that is/ based upon a certain redded expen- 
. diture budget, what neduced number of programs will continue to 
be funded?; the balance of the currently operating programs, ' 
v(non-selective) to then be discontinued"; 3 

Revising the Fiscal Program System * 

" t - . " * ' 

" -1!, ■ t N 

0. . . K \ • 

An alternative to the philosophy of building* anew the system* 
in order to indirectly determine cutbacks, is theft idea, of #v 

' . ' . v ' (* ■ . ' ■ 

given the current system of operating programs and their 
impact/ effect upon the system as a whole, ^what programs 
\ can, be directly selected for roll-^back bas^d upon their 
.'^modeled performance criteria'? ' *\ ' ' 

• • 14 



Through the philosophical stance of revision, the overall objec- 
tive, becomes to choose programs for deallocation, while minimizing 
a decreased satisfaction of required/desired system goal si etc. 
In the case of fiscal roll-backs, a revision approach is the pre - 
ferred procedure, though in a modified sense. ■ 

Si nee. many 'educational systems are so large, as to have 
hundreds of model -related programs, it would be very time- 
consuming to require the modeling of entire systems. An alter- 
native is to model only those alternatives (programs potentially 
available for' cut-back) ; and "to choose from this list of ♦ 
•feasible 1 expendable programs for solving the fiscal, roll-back 
issue. ( - . 

From, a modeling protocol, the role of constraints in guiding 
the; fiscal roll-back decision may be seen 'as: minimizing the 
loss of the contribution to total systems effectiveness and 
efficiency; while concurrently maximizing the expenditure dif- 
ferential which is destined for roll-back. 

Benefits of Itemized Budgeting and Delineated Programming 

■ As discussed earlier, the use of delineated programmi ng in . 
the form of multiple program versions, with different projections 
of discrete levels of funding, can be very beneficial in modeling 
fiscal systems for roll-backs. It was also stated that knowledge 
of the level of required funding (as a composite measure) was not 
as useful as a differentiation of the required allocation into 
specific delineated object areas of expenditure. 

The typical educational budget is grouped into a series of 
expenditure areas (called objects) which pertain to soph foci as 



salaries, benefits, supplies and materials, equipment and capital 
outlay. In a roll-back decision, it is reasonable that the 
decision-maker may desire to constrain some area (object) of 
funding greater than another. For example, the reduction in the 
amount of a floated bond issue may require cut-backs, such that 
the 1 capital expenditure object 1 must be more severely 
constrained than other areas of object expenditure. Obviously, 
the administrator cannot allow programs to be implemented if a 
capital outlay is mandatory, to the success of these programs, 
with no capital monies available. 

Often times the decision-maker may wish to segregate those 
programs which exceed the r average expenditure level 1 from the 
remaining programs f % pr more detailed scrutiny. Such an eva- 
luation could easily be a useful strategy immediately preceding a 
full fiscal study of the current operating system. Finally, the 
impact upon the system of proposed roll-backs .determined by a 
multiple alternatives modeling technique, can only be viewed via 
the individual expenditure categories if and only if the indivi- 
dual categories were originally modeled, 
i 

n . /' 

Testing for Strengths, Weaknesses and Responsiveness to Stated 
Needs 

Prior to our eminent discussion of the cost/benefit modeling 
framework as a historical forerunner to the more powerful opera- 
tions research technique we call the multiple alternatives model, 
it is advisable that' the rationale underlying our preceding com- 
ments be reiterated. . 

Fiscal funding crises require (normally) some degree of 
expenditure xut-back; it has been the theme of this paper that 
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such decisions should be program-whol, istically oriented as com- 
pared to leveling a certain "equitable" percentage share across 
all programs. In other words, it may be more rational to discon- 
tinue. an entire specific program, as compared to under-funding 
several of the generic program's specific entries. To opera- 
tionalize this philosophy, all programs are viewed as multiple 
alternatives to a 'fiscal roll-back decision; and measured cri- . 
teria are used (as contraints) to evaluate all potential com- 
binations and permutations of these, alternatives, to determine 
how rfiany programs must be cut; and which ones. Discrete levels 
of fuhding in order to determine various delineated programming 
alternatives has been discussed as a recoimiended procedure. 

•■ 

The rationale in tjie preceding sections has been presented in 
order to introduce a particular philosophy; and that philosophy 
reflects the necessity of testing for the comparable strengths 
and weaknesses between and among program deallocation 
alternatives; and to specifically determine (understand) each 
program's (or group of programs) responsiveness to expressed ■• 
needs of the problem originally intended for remediation. In 
short, to know what a program is doing and how, and to be able to 
state why that particular program (selected via evaluation 
modeling) was 'rolled-back'. Such are the ingredients of a 
data-based, accountable decision. 



TRADITIONAL MODELING VIA COST ANALYTICAL DESIGN 



The plethora of cost analytical frameworks has focused mainly 
upon four specific evaluative or modeling designs: cost-benefit, 
cost-effectiveness, cost-utility and (though hardly an analytical 



framework, per se) cost-feasibility analyses. Some of these 
models support the use of multiple criteria related to a single 
focus, while other models prefer a singular criterion formed via 
the composite of multiple foci; but* all models agree upon at 
least one postulate: 



, The analysis J[and subsequent selection) of an alternative 
course of action from among multiple alternatives; subject to 
the evaluation of each of the alternatives across multiple 
(or singular) criteria, which are purported, to measure the 
alternative's impact upon the system (of decisioning) being 
modeled; 

and such that: 



(1) positive effects to the system are maximized; 

(2) negative effects (as by-products) are minimized; and 

(3) neutral effects (as dfesirable ) are maintained at the 
central tendency of measured impact. 

To accomplish this end-result, cpst-analysis model ing has- deve- 
loped into a science of graphic displays, measurement schemes, 
and statistical overlays. To date, however, the serious short- 
coming of many of the cost-analytical designs has been the 
model's inability to adequately control for interactive effects 
between (and among) criteria for any particular alternative being 
evaluated; and an inherent unreliability to systemically evaluate 
a multiple alternatives solution (where the selection of more 
than one alternative is necessary to adequately satisfy the 
required demands/needs of the system being modeled). Before, 
solving' this difficult problem of multiple solutions across 
multiple criteria, the reader must first grasp the more tradi- 
tional aspects of cost-analysis design and modeling. 

18 



ERIC ' 30 



Application of a Decisioning Matrix 



The choice of a solution from among multiple alternatives, 
via the evaluation of each alternative across. multiple criteria, 
is easily viewed in a decisioning matrix format (see Figure 1, 
p. 20). With each column representing the values of stated cri- 
teria for a particular alternative, a m X n matrix is formed; 
consisting of m-criteria (measures) across each of n-alternatives 
(defined). And as a 5x8 matrix yields (5) (8)=40 eel Is, so does a 
m X n matrix yield (m)(n)=mn measures for" evaluation. It* . 
remains these mn measures which will then be utilized by the 
decision-maker to judge which alternative action(s) is (are) the 
•best 1 solution(s) to the problem being modeled. 

The decisioning matrix provides a useful formulation for the 
eventual modeling of the fiscal roll-back context. Defining each 
of the various alternatives (Aj, j=l, ..-.,8) displayed in Figure 
1 as potential programs to be rolled-back in a deallocation 
decision, the objective becomes: to select that particular 
alternative (Aj) which hest exemplifies the stated criteria being 
used to make, the deallocation decision; and which subsequently 
balances the. budget. In reality of course the experienced prac- 
titioner realizes that more than a single- alternative program may 
require roll-back if the criterion objectives are to be met. For 
the purposes of instruction and illustration- of the argument 
^however, only a single- alternative context will be illustrated* 
The multiple-alternatives context will be discussed in a later 

section. (Your patience will be rewarded.) 

'■ ■ W ' 

For each alternative A-, then/ there exists a series (column) 
of criterion measures, (i = 1....5), reflecting the 
"nature(s)" of the alternative's measured by each of the 
i-criteria. In the selection of a single alternative, the 

{ : - ■ 
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Figure 1. Standard Decision Matrix for Criterion-Referenced 
Analysis of Multiple Alternatives. 
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problem involves comparing the valid a^ measures in a reliable 
fashion, such that the "character" of each of the particular 
alternatives being modeled is understood; and thus a reasonable, 
rational and informed decision may be made (or at least . 
"sophisticatedly guessed at"). To accomplish this analysis of 
the criterion impact via each alternative upon the system, a spe- 
cific procedure must be devised.. 

.11 1 

The Composite Vari%ble-Rank4ng^CVR4--P-rQcedur-e- -— - 

The reliable application of any procedure to the evaluation 
of alternative action access multiple competing criteria, must 
satisfy at least four primary requisites: 1 

(!) The comparison (evaluation), of multiple criteria for 
each alternative, requires a s'ingle composite value 
representing each particular alternative be computed 
from the avail able criterion estimates; 

(2) The computation of a single composite value requires all 
of the available criterion estimates be- reseated to a 
common measurement format , both in terms of units (e.g. 
dollars, square feet, number of pupils) as well as 
scaling (nominal, ordinal interval, ratio) — that is, 
so that apples can 'be compared to oranges; 

(3) The evaluation of the impact upon the system from the 
criteria being used, requires a method for analyzing the 
criterion impact across all alternatives (as well as the 
value of each alternative across all criteria); and 
finally, 

21 



(4) The realistic, modeling of a decisioning context, 

requires the ability to "weigh" the various criteria 
being utilized, and thereby vary the relative importance 
♦of the criterion effect upon the decision'(s) being made 
(alternative choices). 

The Composite Variable Ranking (CVR) model has been designed 
to specifically address these four requirements. After the ini- 
tial measurement of the criterion variables has been accomplished 
-fe-rg-r- cost of programs^'arts^iTT^'dDllars 1 ; space requirements in 
'square feet 1 or 'number of rooms 1 ; personnel in total 'FTEs'; 
etc.), the normalized T-scores of the relative raw measures are 
computed for each criterion variable (across the, range of 
measured alternatives). That is, 

VV 

a ij 9 J ■ l,...,n 5^ T^-, j = l,...,n 

for each criterion i=l,...,m. This conversion replaces all raw 
measures (square feet, dollars, etc.) with its associated distri- 
butional T-normal. T-normals by definition 'have a mean of 50.0 
and a standard deviation of 10.0.. Thus, a facility-space measure 
of 2560 square feet for program alternative C has a T-measure of 
50.0 if 2560 square feet is also the. distributional mean across 
all. programs for space requirements. Likewise, a personnel 
requirement of 12 teacher aides has, the T-value of 50.0 if 12 
(TAs) is the distributional mean across all programs. 

The composite variable ranking procedure summates each 
column's row entries (that is, adds the criterion T-measures for 
each alternative), producing a single composite measure per each 
alternative' being evaluated. These T-normal sums can then be 
ranked such that their ordinal ly-comparative importance to the 
decision be recognized* 
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Likewise, the rows can be summed (i.e., adding across each row's 
column entries), to understand the relative impact of each criterion 
across all alternatives within the system". Finally," standard- 
weighting practices can be applied to the criterion T-normals (after 
normalization, of course) before the summation of the column vector 
entries. 1 ' 

The CVR modeling technique is an excellent field-tested and 
validated technique for performing most decision analyses 
involving decison matrixes. Moreover, the CVR approach is well-. .' 
defined and easily constructed^for a fiscal program alternative's 
setting. The technique is not without its inherent inadequacies, 
however, centering mostly around its predominant reliance upon 
both a singular alternative context and main-effects modeling. 

Main Effects Modeling ♦ 

In anearlier section of this report, the issue of multiple 
alternatives modeling (MAM) was discussed in the context of a., 
solution requiring not just "one alternative, but rather a finite 
group-^ alternatives (referred to as the "alternatives-mix set" 
in the first topic of the next section). If a. decisioning model 
purports to truly simulate a real situation, then the model must 
be able to compare -groups of alternatives against other groups of 
alternatives, utilizing the criterion measures which have been 
selected to simulate the impact of the alternatives upon the 
system being modeled. This is the main operational difference 
between singular and multiple alternatives modeling -- that 
several alternatives may require operatonal ization to satisfac- 
torily remediate the identified problem. 

• . r < 
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Main/ effects modeling is a correlated idea to the multiple 
alternatives context, from the standpoint of the multiple- 
criterion effect via each evaluated alternative. Consider the 
following example. Five alternatives have been identified .as 
potential remedial actions for a particular problem being 
modeled. Each alternative was measured across each of three cri- 
teria to permit a criterion-referenced evaluation. (To save 
time, and wear-and-tear on the authors, the transformation to.T- 
normals is suspended for this discussion). The measurement scale 
chosen was a 5-point scale with inteVyal of 1 unit, signifying 
low benefit (=1) to high benefit (-5). The simplified decision 
matrix is shown in Figure 2. 

Note that the column sums indicate Al ternative-C las a clear 
'winner 1 in this. "identify the most beneficial alternative" 
contest. However, also note that although C's sum was the 
highest, the. measure of criteria #2 for C (-2) suggests C, 
demonstrates moderately^low performance benefit on this criterion 
measure. If we approach this simulated example from a 'multiple 
alternatives' vantage, a likely solution might be the incor- 
poration of both C and , B into an alternatives mix-set . Note how 
B's measure of moderately-high benefit '(=4) on criterion #2 qqun T 
teracts C's moderately-low (-2) value. Also, note how C must 
then make up for B's apparent disadvantage regarding criteria #1 
and #3. 

M&in-eff ects modeling would have v computed the columnar 
summations, and selected the alternative 'C',as the most-likely 
solution. It is just as likely that in a niore compl icated 
simulation, the decision-maker might not recognize the SHterion 
#2 influence of alternative C. Clearly, this situation is a 
potential problem with both singular and multiple alternatives 
modeling, simulations. 
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Figure 2. -.Representation -of the Composite Variable Ranking 
(CVR) Formul ization for Main-Effects Modeling. 
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The solution is to perform what the authors call "interactive 
effects" modeling — controlling not only for the presence of 
multiple solutions, but also controlling for the potential of 
sub-optimal criterion measures for a given alternative which may 
be masked by the values of other highly-beneficial criterion 
measures. The illustration and application of just- such a fhodel, 
the Multiple Alternatives Model , within a fiscal roll-back con- '* 
text is the subject of this report. ... .'„": ^ ■ .V 



Generic Criteria for Competing Alternatives h 

we have spent a great, deal of energy thus far in describing 
what to do, how and why ... but have gingerly maneuvered around 
the 'question -of 'with' what 1 vjh:. criteria . Criteria must be both 
system-specific as well as al t ernat i ve( s ) -specif i c . Roughly 
transl ated,- criterion measures must reflect bdt'h the ^system being 
modeled as well as the alternative solutions being evalu&tetl, 
respectively. Otherwise, the impact to the system cahn : 6t; ; be 
measured, since it had not been modeled (i.e. simulated). 

' i- ■>' '.'jV '.'. r ^'' '. : , ' ■ '* r-V-* 

The ev^luatiflr^bf^ ^ rol 1-backs is yio 

/exception. Criteria/must be-tniritirduced, measured and an|ilyzed 
; across all al t eriiati y.esy^ : the alternatives can- tfe* 

validly compared t h i rt ;:a-: : bud^ejfcj ng. cont ext ; and the imf&ct\to 
the system of each alternate premutatiorftof 
all available alternati yes.) can be analyzed. Finally, criteri.a 
must be col lectively exhaustive of the 'foci 1 required to v^^k* 
criterion-model . the. decisidning 'context; and allow cross- "' :/ 
comparisons between criterion measures, in order to check for 
. col lectively unacceptable 'impact' values (interactive effects 
modeling). ) \ J X 1 * A - r 



..Modeling ;a1t^nit.ijtes"wfthfn-Vtfie ftsiia j; ;do*ito.Ve^s - ^ii; * as 
clear an illustration of criterion considerations 'as. any . ' 

'.•multiple-alternatives decisioning situation. For. traditional 
cost analytical studies, the 'generic focus of expenditure has 
been the province of cost-benefit analysis. Similarly,' .'-foci of 
effectiveness and satisfaction have remained' 'strong [''^riijscApn 
entries in cost-effectiveness and cost^utility ahalysesi'V >^ 
respectively.; : A.n^ additional measure focus of efficiency ;couB % r- 
find itself in'. either '-of the' three : cos tr anal ys is ; model's v . ; ' ; / 
depending upon its source of data (as is probably true *f or -all of. 

•the initial three-criterion foci).; . V .'C- : '2^'' m ' : ' ' ; > 

. 7\" ; v Nevertheless, these :; ^$ir ; generic ; ;cr : iter ion -foci (effective- V. 
;- ries^, : efficiency, satisfaction and le^nditure) are directly ' ; V 
: - applicable to the fiscal modeling domain: 

**** ] \ 

Effectiveness *.•■*/, :' : 



1. How effective- are each of* the various alternative 

• programs in promoting the district 1 s. generic;. program 

goals? % V Jt {-7 X (•>:•* 

. ' . .i i ' /;..- ■ ■ • 

2. How effective iare each of the various alternative 
programs in .optimally reducing the ciirre.nt problems 
associated with, each of the districts' school ' specific 



program goals?V\d , 



Efficiency ,^ , 

1 . _ - How ef f i c i ent ane^ach of the. var i bus aj-^inat i y< 

programs in coj^^p^ng the required instructional 
; .programs of^h^^strict? 

2. How eff^p^fy^e each of the variotrs alternative 
pr f o^r anfs H^. remed i at ing the current problem(s) to- be 

> s-oWved; within the -district? 



Satisfaction ' , > ; - . / ; : y:- 

1. • How satisf attpry .dre; : each:.'(5f the various 'altferhatlve 

programs in their ^ecdtion, based. upon the : .:distribu- 
tional domains of the '".administrator, .teaChehT st^dent^V 
. ;par;ent;. and .s'cttoo^ ' 

2. ;">, >Ho'w 'satisfactory are each of the-various alternative c 

programs in their remediation of the identified 
problem(s),' Jb.gs.ecL. upon, the distributional domains of the 
amdinistratorv-V&a'cher, student, parent and school ■ { 
board? ■ * % ' . . / 



Expenditure 



1. What are the- specif i\c/bbject costs -to the district for 
each of the varioas : 'aiternatives; and therefore their, 
savings' if rol*le'd«-back? ' ^ ^ . 



: ;:/;:;./';2:ov What are the'costs to .the district 1n terms of benefits 
y 4 if tKe programs; continue? • ". 1 ; 

3. -What are the costs to ■the^ivS^rict in terms of '.loss' if ' 
the programs are roTled-batk^'^^' 

It is likely (if not stroji^l^;..sugg^t^ed> that several cri-* 
teria (measurement Variables;!',^ to adequately 

model : ;:the rather general ides [expressed above. ./or example, the 
critenonifocus of efficiency for a particular set of- alter- 
natives Curriculum programs might be measuredVin terms of: ' 

' -fy* ' ' ■ • , .'V ■' : 
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(1) Amount of time in minutesHthe^rogram requires for %Aiy. 
instrumentation, each week; 

(2) Number of students that , could be handled per class 
session (to identify- small v. medium v. large group 
sessions);, and/or^ - . . 

(3) Percent of time the program requires use of a particular 
laboratory or library resource room. 

Expenditure is another criterion focus particularly suscep- 
tible to the •delineation 1 of its content. For example, the 
total cost of a program is important; but potenti al ly more impor- 
tant is the program's budget-breakdown by object expenditure 
(e.g. amount for salaries v.* amount required for capital 
improvement). Figure 3 illustrates the impact of differentiated 

criterion. foci uporf one traditional decision matrix. 

•> . ■ • % s 

It may .now trivial td :: state that £ach of the four sub- 

majrices^w|t^in 'the total decision matrix could be itself a deci- 

son sub-^at^ix. Thus the a x n effectiv eness sub-matrix could be 

«.. / , ? 

executed^ determine which alternatives best '|$i:! : *j r ne stated . 

effectiveness criteria. In turn, the bxn efMcfericy iub-matrix 

could be executed for its solution; and t\^^ach^^the 

Remaining c x n satisfaction and d x n expenditure * sub-matrices 

could be evaluated. Such a serial procedure would yield four 

sets of answers (alternative solutions), which themselves would 

require comparison for a final solution. The question arises, "Is 

this.really the best, most yaljd (and reliable) process to 

follow?" 

X 

r Hopefully it is also trivial (?) to the reader, that the full 
'decision matrix (a+b+c+d) x n could have been evaluated; the 



Figure. 3. Representation of a Generic-Criterion becisioning Model-: far.; 

Analyzing Multiple Competing Alternatives^- . -. \ \i ■ > 
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solutions determined, reflecting those alternatives which best 
fit, the total effectiveness, efficiency, satisfaction and expen- 
diture criterion sets, simultaneously : and thus, optimal ly opera- 
tional ize the. preferred interactive effects modeling framework as 
previously* discussed! 

A Preference/Trade-Off Analytical Framework 

Although previously illustrated withl^Kthe topic, 
Main-Effects Modeling (see pp. 23), the importance of variable 
criterion characteristics for a given alternative must be 
reiterated. Solutions to real -life* problems are found to be 
"perfect" only in textbooks, professor's lecture notes, and the 
1950's cinema. In reality, all potential alternative solutions 
will be found "to have' at least one flaw (if not many); and still 
be the best ^alternative(s) solution available. 

In selecting a final alternative as a solution' based upon 
that same alternative's merits, the decision-maker* alsp • 
(consciously, we hope) accepts that same alternative's lack of- 
merit on other less virtuous criterion measures. Recall the '■ 
illustration in Figure 2 (page 25)- Alternative C was selected 
based upon the merits of criteria #l.and- #3»> To fill the gap 
indicated by criteria #2, a multiple alternatives mix-set solu- 
tion 'was -sought with the subsequent addition of .'B' to the sold— ' 
tion set. However had we not the option to choose a set of 
solution alternatives, would we have retained alternative 'C? 
At this level of macroanalysis , the answer is probably 'yes'. 

This is the "theory of preference/trade-off in alternatives 
modeling — singular or multiple. Alternative C was the final 
choice due to one preference for high benefit on criteria #1 and 
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#3; and a concurrent willingness to trade-off (i.e. accept the 
negative) the low benefit effect associated with criterion #2. 
This concept is most important in the understanding of the 
multiple- alternatives/ interactive-effects modeling technique to 

be illustrated in Part II of this report; and applied to the 

> ■ 

fiscal roll-back problem in Part III. The main difference bet- 
ween the way the concept of preference/tradeoff has been 
described, and the way in which it is actually applied will be 
evident. Basically, the multiple alternatives model (MAM) will 
define preference/trade-off as a willingess to accept a central- 
tendency solution mix-set, where the required impact is not 
alternative-specific, but rather is mix-set generalized. The 
measures of central tendency and variability (distributional 
mean and standard deviation) will be applied to a yet-to-be- 
discussed marvelous* vector of values called the conditional 
vector, in order to assume their preference/trade-off 
flexibility. 



OPERATIONS RESEARCH AND THE EVALUATION OF 

— * 

FEASIBLE ALTERNATIVES 



Thus far, this report has devoted much of its content to the 
exposition of budgeting and funding as a structural allocation- 
oriented activity. A position has been taken which specifically 
adheres to the philosophy that fiscal modeling (i.e., the simula- 
tion of a. fiscal decisioning system) must be criterion-referenced 
to the, actual (real-life) system; and that these criteria should 
be designed .in such a way as to perform three vital functions: 
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(1) to reliably represent the 'true system being modeled 
(simulated); 

(2) "to validly represent those factors (inputs, outputs, 
processes) which are required (and desired) to provide 
the necessary information in order to make decisions); 

(3) to totally represent the impact to the system (as a 
whole) of the potential alternative decisions being 
evaluated. 

i 

~ Finally, this report has premeditatively focused its energies 
upon; preparing the reader to .view the fiscal crisis situation, 
and its potential demand for fiscal roll-backs, as a decisioning 
framework of multiple alternatives. In this case the. alter- 
natives, are defined as either all possible programs (sources of 
expenditure) or significantly distinct parts of programs which ., 
might be discontinued and therefore deallocated from .the existing 
budget; that is,, rolled- back in order to balance lie budget..' To£ 
evaluate r^theSe./iW^i^.^aT-fcer n at i ve, ' potenti al "sources of cutbacks; 
criteri a are required which will not ..o.nly^'describe the attributed 
of each alternative in termsof itsvcontfibutions to system func- 
tion (or lack of such < contributions) , but will also demonstrate 
the. costs (object category expenditures) associated with each of 
the alternatives. The overall goal then is to select .those 
alternative programs (decisions) which may'be feasibly and 
rationally rolled-back without' providing major detriment to the 
system's required functioning, while satisfying the reduced 
budgetary limits imposed by the fiscal crisis. 
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Optimal Decisioning Within a Constrained Feasible Space 



Any decision, viewed as the best possible alternative course 
of action to operational ize, must by definition be optimal ; that 
is, all things considered, this action posits the best interests 
of the organizations or system being modeled. Simulation of 
these "things" and "interests" results from the use of criteria 
to measure the value of each alternative and its impact upon the 
sysi^em as a whole — that is, how the system is constrained by 
these criterion measures across all alternatives; Such measures - 
are referred to as criterion constraints . Those alternatives 
decisions (when evaluated) will display degree of optimality 
("besPHiess") in addressing the solution to the problem defined; 
but first, each particular alternative must itself be °a reaso- 
nably potential solution to the problem; that is, exhibit the 
quality of feasibility . 

The context of decisioning alternatives is thus a rather 
interesting flow from a traditional needs assessment (What is the 
real problem? that is, not the system of the underlying problem) 
to the determination of a set of solutions to be .implemented via 
a criterion-referenced model of value and worth, versus impact. 
Figure' 4 schematically depicts this (obviously interesting) flow. 

After the real problem is determined, dissected and defined 
(the 3-D ! s), standards and regulations (operating goals) of the 
system become the first set of criteria to impact the simulation. 
Standards provide the necessary data to assist construction of 
all possible alternative sources of action the decision-maker 
must consider and evaluate (i.e. the set of random alternatives). 
Next, established priorities are defined and developed into a set 
of criteria which allow further scrutiny of the random, 
alternatives, and their measured impact upon the decisioning 
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Figure 4. Representation of a Sequential, Criterion Referenced Model ' ^ 
for Systematically Developing a Multiple Alternatives 
Solution Set. / 
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system. Often times, an alternative may be "possible 11 but not 
"plausible" due to certain established priorities. Alternatives 
which survive this recent triterion-focused evaluation become 
known as feasible. Finally, the more important (weighted) cri- 
teria are drawn into the evaluation in order to focus the optimi- 
zation standards for the decisions about to be made (that is, 
selection of alternatives). v / 

The potential existence of an alternative mix-set focuses / 
once again upon the idea of singular versus multiple 
alternative(s) frameworks. Recall that a singular fratmework 
involves the choice of one and only one (^Bflone, of course) 
alternative course of action based upon theflftvaluative criteria 
used, A multiple*alternatives' setting, permits the choice of a 
group of several alternatives that when implemented as a group 1 
(not necessarily simultaneously), produce the desired process.: and 
attain the required result, <:s 



Fiscal Allocation as a Multiple Alternatives Problem 

Fiscal crises provide the budget manager and program admi 
;^ njstrator with a unique experience/ "to accomplish more for 

less". Though tongue-in-cheek", the unfortunate reality of > 
fe^fepjd ay ' s ~ §c o n omy and our best program prognostications for the 
^fi$ : MW^ ! ^ po1nt to a steadily decreasing funding base., Decreased 
^^j^|ng will not however be followed by the public's reduced need 
|;|^-^^pducational services, either in quantity or quality. " 
^^^I^anizational philosophies, goals and needs will stay relatively 
^H^bnstant; yet with a new demand for prioritization and 



demonstrated accountability. After 25 years of no-holds-barred 
development -and spending, can education ^quall^ 1 meet-the new 
demands for austerity and roll-backs, in lightof declining 
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enrollments, school .closures, a sagging national economy and the 
ever-increasing demand by teacher for higher salaries? 

Whether the pnoblem be one of fiscal* al location orV 

deallocation, the funding framework for program budgeting is a 

p 

multiple alternative modeling problem. Consider the need to 
determine which, programs are to be, funded within established ' 
budgetary limitations; and therefore, which programs will not. 
This is obviously a decisioning situation, % whereby the goal is to 
fund as many programs as possible within the prescribed budget," 
based upon: (1) each program 1 s merits,. (2) the overall system's 
needs, and (3) the impact of the alternatives — individually and 
collectively ~ upon system functioning as a whole. Each alter- 
native 1 s merits (type ^and extent) will be measured via the 
various criteria which have been a priori identified as 
demonstrative *of the system's definition of 'meri^t 1 or 'impact'. 
Finally, the cost for every aspect of each program is computed; 
and entered as a, measure of impact to the system 1 s budget/ in 
deciding to implement the program (expenditure) or not (savings; 
with an opportunities cost). 

Concisely 4 stated, the fiscal al location between mult lVle,^ 

. - ■ t 

competing programs assumes the following [ direction: 

To choose , (and. therefore also f ail-to-choose ) some finite 
number of programs from among the available alternatives — 
each alternative associated with me as ur^; -of merit, worth, 
impact and cost — such that: / ' 




1. total (collective) positive impact /to the system is 
maximized (meeting needs, goals and interests); . 

2 .,_tot al (coll ec t j,v,eX~oeg atlv£„ ,impjicj;_l^ mi njmi zed 

Itfbt meeting needs, etc.); and 



3. total (summed program budgetary demand does^not 
exceed the amount of available moni.es. > H£ 

Figure 5 provides a simple outline of the above stated^ goal (s) . 

" While resembling the traditional cost-benefit analytf^al fra- 
mework discussed previously, Figure 5* once again affirms the ", 
demand for an evaluation -tool \which is capable of analyzing the 
Vole(s ; ) of- multiple -alternatives across multiple criteria; and 
selecting those alternatives which Jbest fvt the criterion- 
constrained system (decisioning matrix). Again, we are faced 
with the issue of interactive-effects modeling. 

Interactive Effects Modeling 

In a previous section ( |ain-Effects Modeling , pp. 23), we 
discussed the need to understand the interactive nature of 
selecting from among multiple alternatives; that is, the total 

combined effect of one choice based upon the various values of 

each alternative's criterion measures; and the desire to choose 
that set of al ter native s'^hTCh demonstrates - ^ — 
posite of acceptable criterion values. This is complicated by 
the fact that different combinations of alternatives are possible 
in forming the final solution set. Simply (?) stated, such a 
decisioning requirement is a .nightmare.. • .But can a technical 
strategy bef/ormul ated to address equally the issues of technique 
as well as the fiscal allocation problem itself? Welcome to the 
world of operations research! 
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•'^ lV Figure 5. Fiscal.' Alloca^p^v^as ; a 'Multiple, Alternative 'Problem, 

Utilizing the 'Decision- Matrix Framework. 
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The Operations- .Research (OR) Approach^ . J:.; 

• «%'■' * ■* 

Operations : /research as a scientific investigation and eva- 
luation tool, -views the milieu of decisionrng as a; criterion- . 
ref erei^ce.d.v:C k hoi:ce between stated alternatives! The: term i y / 
"operations research 11 is itself a generic label f^several 
actual' tools, and states that a decision situation can be modeled 
5 ■(•simulated) mathematically . As you will discover in* Part II of 
this report (you've come this far, anyway), the multiple alter- 
natives model employs a particular subset of the 0R : approach, 
called binary* integer programming , which utilizes ;:Sys;t ems of ';' 
'•\ v .STmirTtanequs lineal rneqilafities (roughly equivalent .^to h ; igh 
"i o schqql intermedi^e; Jtl^ebra)l : 

■ Vra afr:;atgebryic r repr es entat i'dri:. 'pfi ' t ffe specif ic decision ing . 
framework, where 'each criterion is represented as a linear ine- ■ 
, quality (the independent variables as the programs, and the 
dependent variables as the total system impact), a value of 1 1 1 . 
(i.e. to choose ) or '0' (i.e. to^not choosk ^an be assigned to 
each of the independent variables (alternative^programs)^ The 
- best _mix of 1/s , and. 0 1 s ( across al 1 mul tipl e alternatives}* is the 
most optimal solution set. Thus if Program 1 = ffV^.'Pi^Sgram 2 = 
J 01_an d_Rro gram- 3^..' LM-of^n-ly-Jthr ee p ro gram^ altern at i v e s ) t he 
dec^s4)pn is to fund\^grams and '3'; and therefore not fund 
program '2'. This the basis for the multiple alternatives 
modeling of a fiscal roll-back situation. 



SIMULATION MODELING WITHIN A CRITERION-IMPACT DESIGN 



The theoretical mathematician would say that in the situation 
of fiscal roll-backs and the use of multiple alternatives 



modeling in performing such .de^is lofting -- the need to determine 
; ; . roll -backs is t h e , n e c e s;s ar y go n ,d vtj b n : ■ an d t h e utility,, of the MAM 
■;.v 'technique the suffWetit^ the existence of the 

•v;~: multiple al ternat'tvef model i rig . technique. However! the total uti- 
:.-> lity of this model extends beyond the ability to .provide/ 

decision-makers with concrete decisions based upon a criterion-, 

impact design. • \i • 

. • . ' \ ; - ' ' ' . \ J 

"Consider the ability (of the^ decision-maker) to test ''Various" 
hypotheses; as\to how certain groups, of alterriatiVes' would "impact 
.the 'system. Consider further the ability to vary the system's . 
parameters (needs,; goals 4 demands, etc. ) and observe .the dif- - 
ferences (if ' any) of programs selected for. funding,' 'based upon 
; :t ^- :n ? wly 'modified constraints.. Such abilities suggest a setti rig 
tn e , decision-maker can accurately (val idly and reliably) 
.', • ;model. a system which 'may, not' yet .exists. / It is the' tripartite 
/• abi 1 i ty to .represent . a system* experiment with alternat i ves 
/ .. (programs funded and/or.cr iteri a utilized), and. predict witn/some 
• • certainty, the results of alternatives actions. 'This, is opera- 
;j|1 : oftar^ setting / or ^sMmul at ion . 

The-Yea'der may be musing, "True, ;but so, mucl^of/the con- 
fidence; placed in the results 'of such; a simulative -model must 
itself Be based upon the assumption^. that the model indeed ... . 
'models' the actual operational setting, both, validly and ' : " :. ; ' 
reliably." Obviously, indisputable. Yet, all of educational • 
research was at one time (if not still) held to *be non-utilizable 
due to the inability to control all mitigating and extenuating / 
forces which convoluted curricular learning, management styl-e and 
teacher attitude findings, ad nauseaum. Recalling that the < 
. multiple .alternatives mbdeling technique (as in other. simulative 

frameworks) seeks only to assist the pol icy .^ly'st.'.s' : , 
■ un derstanding of data. tol;be ijsed in the actual decis'i on-making • 



(regardless* of how), we feel confident in: saying,; "Try it, you'll 
likeo't. 1 ! In today's educational climate, where experimentation 
with policy is' often .timgs both involved arid hazardous to one' s \ 
professional health, the s MAM framework can with obvious effort 
and diligence uncover the > projective relationships betweeji ' 
program, alternatives, criterion impact to the system, and 
-budgeting corfttrairits. 0 > , - : - % ; 

Monitoring System Impact of Selected Alternatives 

■ , ; ; ; ■: 

A final note must be- made for fi scaV model i rig under - .; J 
implementations that is., wbat to do when^tHe choices have beeri 
made, .and all decisions ,are 'go 1 . ^Borrowing'- as we educational 
systems 1 ,, planners did from the;. 'electron! 0; engineers during the 
late I960 1 s,^ the' issue of ; systemic cyberneticism on<;e again beco- 
mes useful . Cybernetic" qualities of $ny jho^ling stragegy simply 
refers to a careful, monitor izati on of the real ^system under* * 
implementation, ,.,as ybu put * your fiscal roll-back decisions into 
effect. J Now, and heretofore fyiforseen consequences, impact, c 7 ■ 
//crater] oh^references. and 'meagurenient: techniques may be 
^discovered, which can 0 be integrated within .the original modeling 
framework^ that js; as- B a new linear constraint equation or 
'inequality.; ' \ - " " .... . 

♦The utility of fine-tuning 1 a decisioning/model for more 
accurate future use is certainly- moot . As in multivariate 
regression, the model developer, may have to try new. criteria 
constraints (variables) to associate 1 then r variance patterns with 
the- decisions modeled, and the resulting impact (s) of the deci- 
"■ sions made. • ' ' 



• BACKGROUND TO THE FIELD INVESTIGATION ♦ 

We have attempted throughput' Part I to prepare the reader for 
the technical discussion to foil ow' in Part II and thefield-. . 
research results, to be presented in Part III; concerning the* 
development and /construction of the multiple alternatives model 
(technique) and its application as a fiscal roll-back decisioning 
model, respectively. To date (and possibly mtfr.e understandably" 
having attempted' to trans life the discussion in Part I) little 1 
; ' has been accomplished $1 ,the appl icaiton..'bf MAM-type models" to / 
educational decision-making. In. fact, the first systematic com-. 
pil atixm of areas where mathematical modeling had been .appl ied to. 
education was found iff one of the author" s own works (Wholeben, 
1980). For the reader' s interest, these surveyed areas of appli- 
cation are listed' in Figure 6. - * 

" ' . . 

Noteworthy is; the fact that no entry In Fig'ure 6, demonstrates 
work in applying a, MAM-approach to the fiscal environment. 
Certainly, an OR model could have easily assisted educators 
expend the bountiful monies of the I960' s; as well as today 
select-areas where money will no longer be allocated. This paper 
makes available such ,3- decision" making tool , whose' purpose is: 

... ... }" i t ■'• *■ "i 

; To (design, implement and evaluate 

_ * mathemal^ " 

i • ■ . and its utility itf determining programs 
■ for fiscal rollback , ; 

In this final section'of Part I, early, multiple alternatives 
modeling applications and design will be discussed! Results from 
an initial trial exercise in fiscal data will also be'briefly 
presented, prior to the in-depth investigation i.nto the recent 
roll-back' analysis and. field study found in Part III. 



^ FiguVe°6. Stratification of Operations' Research (,0R) Applications 
* > -Within Educationally-Related "Environments. 
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Precedent Modeling Application 

During -1977.-79, extensive work was accomplished in the 
and' evaluation of a basic main-effects model for compari 
mentary school sites across competing criteria, for potofitial 
■ closure du^ to declining enrollment.^ In addition, earty work 
commenced on the research and development of a 
multiple-alternatives, interactive-effects model during 1978, 
resulting kt a Sophisticated school site evaluation (closure) 
model, and a major technical publication concerning its eva- 
luation design and field applicaton. 

During 1980, further design studies were formulated which 
addressed application issues in curricular development (GAP: The 
Curricular Activity Packaging model); and fiscal roll-backs 
(ROLBAK-I Model). Through statistical studies of the' "school 
closure" multiple alternatives modeling framework (relationship 
of criteria-to impact and solution; and the relationship of 
modeling process to solution content), validated the mode"! as a 
reliable and useful tool. The later* CAP-study demonstrated the 
supplemental utility of the MAM-framework is r*6.t only evaluating 
between-al.ternatives comparisons, but also Within-alternatives 
comparisons (i.e. sub-program analyses). These analyses led to 
u the 1980 application of the ROLBAK-I, a predecessor to the 
ROLBAK-II design discussed in Part III. o 



OUTLINE OF THE TECHNICAL REPORT 



A more technical and consolidated discussion now follows in' 
Part IT concerning the design and construction of the multiple 
' Alternatives model ; These sections were added for the more 
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.discerning reader who wishes to understand the content and 
•process, as well as the results. We recommend that the readers 
study Part II (for as' long as frustration allgws). However, pro- 
ceeding directly to Part III first (returning to Part II, of 
course) may help others in their eventual translation. 

Part III discussion details the ROLBAK-II formulation; and 
the analytical results of the execution. We have chosen to 
include most of the display figures in the text rather than force 
the reader to constantly "f 1 ip-ahead" to an appendix section. 
Moreover, inserting the figures in the text will also force the 
reader to at least consciously encounter them. 

- Part IV concludes-the report with a brief discussion of major 
philosophical issues underlying modeling simulation. 



•¥v. m 
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MULTIPLE ALTERNATIVES ANALYSIS 

- AS A - 
MATHEMATICAL DE CI SIGNING MODEL 
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INTRODUCTION 



To include or not to include a more detailed and technical 

decision" of the mathematical design within. the MAM — was a long 

jmd arduous decision for the authors. On the one hand, inclusion 
of a technical section (we reasoned) might sensitize the general 
reader negatively; and preclude that reader's pursuit of the 
remaining text. On the other hand, exclusion of that same sec- 
tion (we rationalized) might very well undermine the final accep-- 
tance of this; report . as a yali'd ;technique. 

Our final decision, to .JncTude;.at : least some minimal amount, off 
technical development was.- fiwde, .ba^^ u]pori four premises: - 

(1) though a technical decision may in fact threaten some 
readers, the Multiple Alternatives Model is (also in 
fact) a technical design, for which we neither minimize 
nor apologize; 

(2) a technical discussion will add credence, to the 
operating mechanisms of the model, illustrate its inter- 
working parts, and promote a detailed understanding of 
the "input-process output" relationship --.far above any 
"Trust us, it real ly works !" manuever; 

(3) the technical formulation can be both informative and 
documentary, without reading like a biochemist's report 
on the postpituitary hormone, oxytocin (that is, 
C 43 H 66 N 12°12 S 2» if V° u are interested); and 

■ , i t ■ 
(-4); -a- responsible- reading of Parnr'has^ " " 

the reader to the, general . ideas of Part II: that in 

. * 
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fact, Part 1 1 shou Id be. a." 1 r;eca'i 1 ' : ep.i sode for the 
material al relay al't^ fiscal 
discus$\pn. ? ' ; ?A V ;"' r ' 

The presentation^^ Parfr^^ sections which 

follow a very simple introdtig^ evaluation (or 

execution) and val idation paradi^ '■■■'^(jfe^.ili&cussion is void of. 
any particular prob 1 emat i o^cpat ext :(s ; qtti V^s • ;t he fiscal roll-back 
milieu of Part I); and ttiys^ 

specific in scope. S u c h ;an: , hdO cti v.e • appro ac h , viz . from the 
specific in Part I to th^ii^ II, will hopefully 

not only promote betters ^ the MAM 

technique, but; will mor£q>S^ to review the 

manuscript mor e q 1 o s e 1^- fof : ; V Vts/;i ntu iti v e and general liable • 
applications tp; bthetf^^ \ ,. • V. i 



. '\ <*Jhe *Mul tiple Alfer ^ (MAM) f r amewplf k V malces ? f om 

. assumptions of , the problem; (deci sioning) areas to whie£..ijt ; f 
(mpslelr)^ is to be applied First, the problem is a multfpHe 
al ternati ves . problem;;: r equ fmn g va mil 1 1 i p 1 e al t er n at i v£s^so 1 Ut^d^ v v 
Jhg t^is\ .t q/l^ti i : 6 rv 1 0 ^^fe . s i^e c if i e d p r 6 b 1 em -sit u a t i o n dti u t& ' 
reasonably ca^ I f br^^ of more than one o^'tlt^:^ 

v al ternati ye* cour^ uated. Whether i tVbfev ^: 

, schools: to; -'be elq's^ cut, programs to be imi tinted, 

or routes ;byer^hi^ —greater than pne-'v'.-^ 

■ .s chop 1 ? ■ : b.u cfg et ^ pr pgr iw^dr; • : r.du t e may be selected as the solution*^ 



Secondly, criterion reference points (i.e., variables) can be 
quantitatively measured for each of the defined alternatives, 
demonstrating an alterative's impact (if implemented) to the 
•system, according to the criterion's derived focus. Furthermore, 
this arit hmet i c 's ummation of al 1 • selected ' alternat i ye ' s cri- 
terion values (across a particular criterion) forms a composite 
numerical value which illustrates the solution's impact (selected 
alternatives) to the system as a whole. 

Thirdly, the system being modeled can affix some high (or low) 
limits to these criterion summations, .called upper (or lower) . 
bounds. If alcriterion me'asi^e§; f ih^|2ital cost of each prpgram 
being considered for implementation, and a total available budget 
of some specified amount 'exists' — then the summed total of all • 
. program budgets (for the program to be implemented) must be. equal 
to or less than the total available budget. Obviously, you can- 
• .pot spend; more than" you', .havev.av.ai l ab.l e ( al though program.- admi - 
nistratdr's do it r e 1 i g i o u siy|:V: vV I n ;%h f s: : ex amp 1 e , the total budget 
available is seen as an 'upper bound' 1 Similarly, a 'lower bound' 
could be the total amount to be cut from an operating budget',", 
where the criterion is the cost-to-be-saved for each of the ; , 
potential alternative programs (budgets) available for roll-back; 

Finally, some one, individual criterion measure is identified 
which wil.l be utilized to optimize the selection of the final 
al ternatj_ye; nn_x-s,et sol_ut ijn^_ Jla^ 

is, combinational permutations) can usually be identified which 
will provide a solution to some degree or extent. However, * 
reality normally requires an adherence to some priorities 
existent within the system being modeled; for example, a desire 
to maximize the number of students transported (on the average) 

- v i a ~^Gh-bu-s;--or-^de 

has to make enroute to the school. , 
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The Multiple Alternatives Model is. a complex response to a 
complex decisioning situation. The model recognizes the need to 
simultaneously evaluate all available alternatives across all 
defined criteria, and to therefore simulate the interactive* 
nature of a cr iter ton- inferenced, decision-making environment./; 
Above all else, the MAM framework provides a ready ijie^ns f,otV6va- ' 
Tuating^a set of alternatives, col Tectively .-- and based upon-thfe^-; 
set of criteria which tfie-Veal -1 if e decisiorirjii'ctkers have posited'"' 
as the vdes-ijred ingredients of their final decision. 

Role of Multiple Alternatives in Dec i s i pri-M'ak^ , , . 

In the-rriul tiple al t er n a t i v e s\ co n 1 6 x t , : : t he. a 1 solution 

alternatives, may be displ ayed "a£;£ serial st^ri h^|K;tK;ai: is, - ' ■■■^v'K'.^ 
x l x 2 x $ ••• x n where x j represents-; the jth alteratives (of n;' -V\y\;/'. 
total), j = 1, 2, n* The- I^M'decisionVis to include ,(,or r . 

exclude) each alternative 'as a member of the final . S.6i let; 1 oft:;":;* "^■"''i- 
; (mix-set) i The only value which Xj/-may assume is '1 1 '0(^ap:';^s, : .\ 
to ' include ) "s .;'0' (that is, to, excTud^ vl^ ' ;; 

is to .m^theriiatically assign either 'the; ;;ya5^:of 1 or/6:;t4 each of 
the Xj alt^natives, j = 1, 2, n; label, binary , 

integer programming. 7 , . ' 'V^;-; \ 9 

In 'each : case of ten alternatives., the serial representation 

WQU;l^-be^Hrtis-t-r-at-ed--ast-7 . „-z =t==== =- 

C x l ft x 2 x 3 ^10 3 

If the final solution included alternatives 2, 5, 9 and 10 as 
members, then the Solution vector would be displayed as^. 

CO 1 0 0 1 0 0 0 1 la.. : 
50 
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As we will see f in the next section, the function 'of a binary 
9^ding (0,1) Je^tend^ beyond its use as an easy, display mechaaism 
for alternative solution membership. 

* '?? : 9 "7 

✓ • • * 

We have seen: that an alternative betomes part of the solution, 
by taking on the value of 1 (that is, xj = 1 for some j of n); as 
opposed to the value of 0 (xj = 0, for -all j of n, such that Xj = 
1» j = 1;, 2, n). the basis for assigning l's v. O's, lies* 

in the Valuation of the criteria' iflnch were selected and 7^*$%. 
measured^ to indicate each xj's impact 'upon the system ; beTng: ' '•- 
modeled." Furthermore, it was the 1 summation of the criterion' 
.■values across the selected (solution) alternatives which, for- 
mulated the multiple alternatives solution (mix-set) impact to. 
the system. ' ■■ 

Let, us define an 'a 1 as representing the value of afiy cri- 
terion for any ^alternative. It is relatively straightforward 
then to interface ajj as the value of the .4th .criterion's measure 
for the jth alternative. For example-,; recall our previous 
example of ten alternatives. If there existed only one criterion 
to assist us in evaluating the set of potential solutions, then 
the. criterion values could be represented as: 

C a ljX a lj2 ; a lj3 a 1>4 ... a ljl0 3 

In a more* complicated example, a set of. three criteria used to' 
evaluate ten alternatives would be represent^ as: 



9 

/(»..,. 



C %1 ' a l,2 ' a l,3 a l,4 a l,10 3 

C a 2,l 1 . a 2,2 a 2,3 a 2,4 •• • ' a 2,10 3 



C a 3,l a 3,2 :• a 3,3 * a 3,4 , a 3,lP 3 - f' ; ^fe, 



>••••■% 



5 : r*. 



The first case involving only a single criterion, is cal l^d/a .<* 
. vector of criterion values across; the potential alternatives.' : ^ V < ' ;' 
The second case where three criteri a existed^ is called a, matrix 

(i.e., a collection of -/two or more vectors) of criterion values \ 

■"« ■ . ' .. ■ r • ' ■ ■ # 

. across potential -alternatives.^ ^Si'hce^most'-'I^M. problems "involve * 

more than , a single criterion, and because each cr iter tons' ; , '•■ " 

measure will be -Utilized to constrain* the decision to be made (or . 



more appropriately- guide the selection,;^ alternatives for inclu- 
sion within the solution stet), the, matrix is known as the 



constraint matrix; 1 . 



. At this point, we have introduced-- the variables of Xj(j. = 
1,2,..'., n) and a-jj(i = 1,2, ...,m;j = 1,2,... ,n) to represent 
the alternatives and criterion values, respectively; that is: 
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\ 


x i 


x 2 


, x 3 ' 


• * • « x n 


^^nd^criteriw:"~;* 

• 
• 




" a l,2 




... '-^ 


. a 2»l. 

• 


a 2,2 

. ■ 


a 2,3 ' 1 

- - 


... ' a 2> 

• 

j 

*" • 


mth criterion j 




a m,2 


a m,3 


• 



Can^you see (?) that a further refinement of the above scheme 
could be made to appear, as 1 ows : *' 

• * •• j* * . • 

[ a l,l x l a l,2 x 2 a l,3 x 3 ••• a l,riy x n 3 

,. C a 2,l x l a 2,2 x 2 a 2)3 x 3 ... ., a 2>n x n 1 



t am, 1X1 am, 2 *2" ^3 X3 ... a^ n x n 5 

JMrsIM!Lej„s^ns-e_ji^yo [i rec ^JJ-that; — ^(.ip^ely^^of-eaeh— 
Xj/wilT be either a 'O''or a '1', depending upon whether it is 
excluded or included within the solution set; and that (2) the 
sum of the criterion values measures the total impact of the 
solution upon the system. 
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..Consider a relatively, small example of foup alternatives 
being measured across three i c'riterl a.*. Thus the model would'tfe, 
: represented as: . 

^^jl^^ imp'act if CRIT #1> 

a 2,l x l/ + a 2,2 x 2 + *2,3 x 3j a 2,4 x 4, : (system impact if CRIT #2) 
^ a 3,l x l + a 3i2 x 2 ct- a 3,3 x 3 + a 3,4 x 4 " /(system impact if fcRIT #3)* 

' Now if tbe- 'solution vector Cx'j^ ,x 2 X3 x 4 3; was represented as 
: ll 0 * 0 lj where, only alternatives Jl and #4 were, selected, the 
mod el -would ^be shown as: J \ : • ;.• ■■"•Ti"f ~7"'"-~ ^-a.-- . :• 

^ \ : ; ' a I,lU) + a l,2(0) + .ai; 3 (0 : j t ^1,4(1) . ' . 
■ I ,p. ' ■ > a 2>2 (0) + 42,3(0) .+. a 2 , 4 U) 

■'•'■.<; ;•; ./••/ ; a 3,id) + a 3>2 (o) + a 3 , 3 (o) + a 3 ^) 

or in •reduced form: ... ^ 



; a i : ,i a^ 4 • • .. ' (solution .impact if criterion # 1 ) - . 
.'" a 2,l +: a 2,4 (solution impact if criterion; #2;) ; 



; iS 3,1 + a 3,4 (solution impact^f criterion #3*f' 

We now see why previous discussions of otracfefoff /preference 
and interactive-effects were germane to the MAM 'development'. 
Note that ff d 0 0 lj is to be our solution, th|n:the values 

_ of ta l,l' a 2,K .^j'l^^ 

x 4 = 1. Thus the solution Xj, j = 1,4 requires* that. we accedt* 




the criterion values of (ay., ^ a 3 ; 3 ); j =-.1,4 whether they 
are most desirable or/ not. /khat'we, also know js .tTiat the. choice 

; of Xj-.. an d x 4 as solutions must ;-coirrcide 'with thy-, upper/lower- .. ' 

...value, reistri ction placed. uptfh the criteri a. -' • ' 

. ;>•;•..::•..; - . . • ; /,;•♦ 

' V , ■ •< » ••' " ." • • ; •. - • . "... 

System. Bemand- and .System Impact 

The limits placed. upon each- of the composite .measures formed 
"by~sumnm^' each criteri o'n's impact across, all solution alter- 1 .-'* 
natives (i.e.,. Xj> 1 for some j of n), reflect twp closely 
related, ; sy$tem-stimul ated components : demand and impact. 



System demand, exempl ifies the, need(s) of the system bv the — ~ r 
demand(s) "placed" upon the valu^- composites of -'each, criterion 
summation; tftlt is, the u'pger tar 'Lower .bounaVof , the criterion 
sum across the selected solution; alternatives* However, -si nee ' 
the bound is .established dnly as a limit (not -to be (violated), 
then it is reasonable to assume these sums will seldom be equiva- 
lence the bounded value; that-fs, the composite may be spmewhat 
less than the,, established -upper bound'; or somewhat greater, than 
the established 'lower-bound. -The actual valiis and its distance 
from the bounded value, 'is the measure of system impact .(for each 
. criterion, of the alternatives selected as solutions). ' • . • 

y ...Based upon the already linear relationship between the cri- .. 
ter i-pn-valtieis and Vlteratri-ves ( d.ef i ned > as' ; 'coeff f ci efts" and "Tride- 

, pendent Variables ,, respective! vj. it is a simple extension to. 

"•mo'del these cnter.ion, limits as* a. function . .Of/ ipequal iti es . ■ Thus 
in a three-a 1 ternati ves , two-criterion model (requiring a 2 x 3. 
constraint..^ the first criterion has an ' 

upper -bound required,, and the second criterion', a lower-bourif -- f 
the representation may be -stated as': ; ,. . 



a l,l x (l- + a l,2 x 2 + a l,3*3l b l 

* : a 2,l*l + a 2il x^.+ a 2i 3X 3 rh2 " • 

" . «* . 

where b^i = 1,2), are the upper and lower* 1 limits of. the first ar>tl 
second criteria, respectively. Thes.e* values bf are known a| £he * * 
values of'the right-fend side (RHS) of thp constraint matrix; the 
Valueis b-j in vector format (b^, b£) are referred to asnthe .entries' 
of the conditional sector . Therefore if the solution vector tl 
1 \ Oj is to be analyzed, the following algebraic relationship 1 
must be satisfied: * , ' 



. a U x i + a i,2 x 2 1'4i • .,; 

a 2,l x l + a 2,2 x 2 i,b 2 

If moreover a particular constraint t crij^er ion relationship)' 
exists such that : an equal ity is required, the linear equality: 

a i ,l x l + a i,2 x 2 + -V- + a i,n x n = b i i 
is useful and Valid. * • 

The utility of linear equalities and inequalities, in formulating 
the multiple alteratives model is obvious. However, it is reasonable 
to' expect a situation in which more than one set of alternatives pro- 
vides a solution to the MAM problem. Irf these cases, additional 
system priorities must be set., 



0> 



4 



56- 



Syst^ Pri oHties and "the Objective Function 



Consider the circumst.an^where in evaluating the above three- 
alternative, two-$h*ter ion problam, two plausible solution sets became 
evident: t\ %r, and cO 1 Ij. .§ince both are plausible, we know 
* that each of the re&fctionships*: , 

9 



and kJ I 



* * a y x l + a l,3 x 3 I V 
'. •• a 2,l x l + a 2,3 x 3 I b 2 



a l,2 x 2 + ' a l,3 x 3 l ^ 



^ a 2,3x 3 + a 2)3 x 3 , y b 



2 



are individually, simultaneously satisfied. The question : 
becomes: how to- choose b|twei?n*the first •( tl 0 la j' and second 
(CO 1 111 sets?° ?• O 



The MAW framework provides a,,solutio'n to this dilemma, via 
the»use of another .^cHeri op called the objective function (orlf 
cost'vector ). Unlike the criterion ^constraint inequalities,, the 
dbjecti^, function does not have-iin establish^ upper (or lower) 
r \ bound assigned. Rather t,h*e criterion coefficients for the objec- * 
•tive function (labeled c-j, j t*2^...,n) are^. summed' and fhe 
additional" demand 'est abl ished that ^Rher a maximum or minimum sum 



be found. Consider the following Scheme: ^ 



t 
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1 

ft 



(Alternatives) 
x l x 2 x 3 - RHS 



0 



criterion #1 &ll a a , b x 

criterion #2 • a 2 1 a 2 2 a 2 3 * ' ^2 



(objective function) C2 j C3 

, If the criterion referencing the objective function was of a 
positive-consequent nature,- that is measuring good* effects of 
each of the potential alternatives, then it is reasonable' to 
desire a maximum value from the^sumrnatiori of Cj based upon the 
alternatives Selected as solution. r I 

» *, . - » 

/ If the solution cl 0 lj is selected, then the evalua^-on 

of: v 

* c l x l + C 2 X 2 + C 3 X 3 

■results in the' composite: * ^ 

y »- • 1 ,.- ■' . 

f . • ' • . - ' . , c l + eg . 

• v . . ' ? , 

Likewise, ,the solution set cO 1 la results in the composite: 

r. 

• \- C 2 + C3 . " 

^ *j are positive (i.e., good and desirable ) measures and. we 
therefore wish to maximize the c_. "summation — it is intuitive 

* ' * • '* ' . r 
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that .the greater, of the (( Cl + c 3 ) and (c 2 + c 3 )) values will 
decide the final. 'choice between the el 0 la and .eO 1 la sets, 
respectively: That is, if in fact (c 2 + c 2 ) * (Ci + c 3 ), then 
the relationship: 

maximize c 1X] _ + c 2 x 2 + c 3 x 3 

yields the solution . set cO. 1 ^|i| r w1th a maximized 'objective 
function of (c 2 + c 3 ). The idea of maximizing (the "good") and 
minimizing (the "bad") the summation of the objective function- 
coefficients, demonstrates the issue of optimal v. feasible 
solutions. Both cl 0 lj and cO 1 lj were feasible solutions 
in that both satisfied the limits established via the inequali- 
ties and the values of the RHS or conditional .vector. However, 
the tO 1 lj solution was optimal as it alone maximized the 
objective function summation. 1 

In summary, this example could have been stated completely in 
the MAM framework as follows: 

To maximize : c^ + c 2 x 2 + c 3 x 3 

SUbject to : - . a l,l x l + a lV2 x 2 + a l,3 x 3 1 b l 
a 2,l x l- + a 2,2 x 2 + a 2,3 x 3 i b 2 
x jv= (0,1), j = 1,2,3. | j 

The next section will foa^in greet er^detajl on the, actual 
quantification of the coefficients; and the d^lopment of bounds 
for the conditional vector. ««r . ■ • •• 
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CONSTRUCTION OF -THE MULTIPLE ALTERNATIVE MODEL 



Simply stated, the Multiple Alternatives Model is a collec- 
tion of simultaneous linear equations and inequalities, with an 
additional string of serial values (the objective function ) 
available to. "break any ties" which result when more than one 
vector of solution values' (0,1) exists for the independent 
variables (the multiple alternatives). General ly "speaking, these 
equations and inequal i ties which make up the constraint matrix, 
and conditional vector (righthand-side) coul<3 be further 'labelled 
as the dependent variables (the foci, of th;e particular criterion 
constraints ) . 

The coefficients of the cri-terion constraints, the a-j ^ values, 
reflect measures for each' of the xj alternatives (j = l*..*sn) 
across each of the defined i -criteria (i = l,...,n). The 
b-j values (i = l,...,n) of the RHS (right-hand-side) represent 
the limits (upper and lower bounds) placed upon the'sums of each 
criterion, summated across all selected (i.e. solution) 
alternatives. Since a selection means that the .specif ic xj value 
will equal 1 1', then th$ criterion value- ai-xj' (° r *U times 1) 

forces a-j . to be an added to the sum. 

*J ■ « ; 

We may now improve tremendously ^oh o^ earlier charac- 
terization of the decision matrix (see Tigure 1, Page 20)1 By 
adding the ideas of the conditional vector (to insure flexibility 
and the potential for tradeoff /preference)^ we are able to model 
the interactive-effects premise required of multiple-alternatives 
decisioning. Supplementing the model ft^.ther with an objective 
function, the set of feasible solution 'alternatives can be 
further analyzed to chooie the s-ingularly bes|: alterative mi-x- 
set the optimal solution. Figure 7 displays the scheme of the 



Figure 7. Representation of the Augmented 'Depi^si on Matrix Model 
^ as the . ■■My.l tipl f e."' Al t^-pati ves'-'Mjod^l " (MAM) . \. V''' 
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V ,<^T^^ only.) " 



TO 



v. • tJiV 



v augmented model , within, the original eight-alternati ve/f^^: ; t ^. - ; 
' constraint mil ieu. We may now. proceed to discuss in gre|^^-^, 
, detail the measurement, arid operational schemes whi ch arilJ^iSVe/ 



(and desirable ) w i th i n tKe' framework . 




' ^ Sgner ati on ] of C o 1 1 ec t i v ely-Exh au s t i v e A It em at i y es : • > 

\V a 1 1 cL go ns t r u c t i o n and reliable execution of the$^ 
V : req.uire5'>th^ user to recall c ert a i n r u d i men t ar y f ac ^^fflrrb a§3 c ^ £ 
. . v ;f es e ar c h. .^a n d e x p e^i m e n t a 1 design, .and statistical ' J| 
y i ss ues of; go! 1 ecti ve-exhausti veness . and mutual^excllT si ven^ss". 
. 'wrll del(ay c th6-' discussion of the mutua&v exclusivity 
alternative sol ixtiohs until a later \section. ^-I^^ver^fie 
of- -coil ect^v-ely- exhaustive alternatives is germane /nowV^'^^S! 

' ^ * l^fie^two.^ st|ltn,g suits*!: •( obviously^ ^qri^^^^^the 

^T.^^^^-i-3T ^^n^^^^^iv^" r - ^"^^""C'i 0 '&dVilr o 1 of interactive effec^ 



:(2| ^asuftev of total * system impact. Interaatf# 



and. a- 
ts modeling 

v pr^v^ed control .otfer ; t he rather complex mv1i^^>roduced, when 
^;^^;^siWmaki^g was : ,evaf u at if| muftiple. alternaf^e solutions / 
^/acrpss mu^l t.^ple-'-ppmpeting criter*ia t - Single alternatives could f be 
^y'^a'sur^d as. 11 good; or '"not-IS-good^ri vari^^criteria - ^ofh r ' v 
"->~~ A + A ^i4.„»i„„ — ^^-^er ; . alternatives,^ 



/■.pai^d measures 



■^ofl; anal#z$d :r as to. whi f ch alterative i^displ ay'ed the best-mix of 
'fqpHt i^^^s-MPes^4^'en companed,>>h6^ever : , di^Mome set of 



v^ltern;at^ a' better 11 int er act "^-mix"'. than ' : ./ : 

\/^'4rtp^% And, wei|e different ; ' |mou'ntPof alternatives ^ \ ' \ 

• \^qU-jr-ed for, .ei|her?,!|Thus, interact! ve- elects model ing assumes ^ 



• ■■; M gh^y cbmpl ex. in^erttei ationships not only between .sets, of * . 



; ; , rh Li.1. t *' iil t ej^a n t;? yes f and among (within 6 ) those same 'sets;;- but 

interactions between t h e cr i t er i b n ,me as U r 6s ; 
: ;:;jQ|:;tHo^ (both singular and multiple) >-^he' '.; 

. -„ii^ a trade-off /preference potential, • - 
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The other 'strong suit':of MAM centers about the issue of 
measuring total system impact , You-will recall, that the 
RHS-value.s provide a control upon. the summation of each 1 criterion 
constraint— thus limiting the impact which the selected alter- 
natives will be "allowed 11 to foster. However, RHS-values 
establ ish either an upper-or lower-bound to the summation, not 
the actual value, which the summation must ass-ume. Therefore, the 
true sum for any criterion constraint , might very well be (and . 
usually will be) different than the pronounced limit; that is, 
somewhat less than the upper-bound, or somewhat greater than the 
lower bound. In this way, the desired impact to the system is. 
-controllable but moreover, the actual impact to. the system is 
measure^able. By .knowing, the' discrepancy between the desired and 
actual impact, the MAM model can be used to detect changes to the 
system (i.e., differential impact) which may occur through the q ' 

selection of different alternative solutions. 

. ■ . ■ 

'.. • . tf • ■ ■• 

It should be obvious to the readgp that neither \the control 
p^interactive-eff ects nor the recognition of system impact via 
-varying alternatives 1 configurations, is possible without the 
^exi st ence of aY^ possible, feasible, and relevent alternative 
^S^urs^of action for consideration. More succinctly, the set of 
multiple alternatives being evaluated across the defined criteria 
constraints must. exhibit the.eharacteristics of a collectively- 
exlflustive population of alternatives. The exclusion of any. 
alternative from* the model automatically precludes its impact 
upon the evaluation of the remaining alternatives, and its impact 
upon the system as a whole. 



Criterion Measurement and Constraint Formation 

Since the criterion constraint represents s a linear relation 
(either equality or inequality) of the form: 



a i,j X J + a i , j+l-' x j+l 



, + ... + a i>n X n (t, =, >) b i 



or more concisely: 
n 



3-1 



a i 3 j x j (* 5 => > ) for each i - 1, .... m, 



extreme caution must be used in developing the a?, coefficients 

'j 

of the Xj decision variables. Obviously, each a^- must be 
numeric; and further exhibit such qualities as to allow their 
arithmetic sum to be a rational and useable quantity for com- 
parison with the associated b^) RHS-value (discussed in the next 
section). , 

Four "basic scaling schemes exist for measuring and. encoding 
data: nominal, ordinal, interval and ratio. Progressively 
"inclusive,- all can be utilized to formulate the a— coefficient,, 
dependent upon the definition of. the particular criterion • 
constant (i .e." its' focus) . The most common scales util ized . are 
the interval and ratio measures, due to their abi 1 ity to compute 
measures of central tendency (arithmetic means) and distributive 
variation (standard deviation) .i* We will limit our discussion to 
these scaling techniques only : . . : v- 



.Data concerning program expenditures (e.g. in dollar-units), 
number of required personnel (e.g. in FTE-units), or energy con- 
sumption (e.g. . in' BTU-units) are easi ly ratio-scaled measures. 
Other data which might be obtained from sample opinionn%rres con- 



cerning the respondent^ perceptions towards each particular 
\ alternatives might, easily be Jnterval-scaled (e.g. asix-po^nt 
. continuum. measure associated with^a 'Strongly Disagree, 

Strongly Agree 1 response format) . 

Gon^ider the objective:" \ : • , .^-V;. 3 . 

. "To deallocate such program /alterriaTVes as: will secure an 
expenditure savings at least some a^nl^^AVE'V! • . 



Clearly if we cost-out , each program alternative^ and arrange 
. the constraint as follows:, * 



• $ i,l *1 + S i>2 x 2 .+ $ i>3 X| + ... $ ijn x n I $SAVE„ 

then the solution vector tx, x£, x 3 /.-... x ri J must be of such (0,1) 
configuration as to allow the sum of the X : to be at least the 
amount $SAVE - or greater. This is one of 'the easier examples of 
the use for a ratio-scaled criterion. 0 



. Consider another .objective for 

,"To. deallocate such program, alternatives as will coincide -: 
with the public' s opinion of each .program 1 s relative lack'of 
merit." ■ 

. Suppose. that a questionnaire was sent to a random sample of 
individuals, wherein the question was asked: ; 

■ • < - ' 

"Program Xj - fulfills the needs of the community 
to which it applies.". •. 



V 



and the. response tall ied via' the use of the following format:' 

. . 1 ' 2 3 . . . ■ 4 . 5" 6 ' • 

Strongly Disagree .Moderately Moderately Agree Strongly 
♦ Disagree .... ; Disagree Agrea' 7 . Agree 

where a lesserymag'nitud^ (i.e. 1, 2, . . . ) ciispl ayed the . 
respondent's disagreement with the item elicitor, and this 
measured, a negative response to the perceived merit foi* each of 0 
the programs. If 100 people responded to these items (one for 
each program altern&tive), the 100 perceptions' (1, 2, . . . , 6| 
coul d be, averaged and compiled into the. constraint serial : 

; • v.^ - PCP iv xi , + PCP ij2 x 2 . +' ... + PCPi, n *n 

where PCP^ is,;the. ith constraint, and represents the: group's 
(N=100) perception (PCP) of worth or merit for each program. Of 
course, a value for the RHS*(b i must be Computed; and: we will 
survey this-deyelbpment in the next section. ■ 

. The importance of each xi^terion constraint within the, 
constraint matrix Ties in its abd l;i ty to model each alternative 
singularly 4 (.vi a the indtvid^kl a i -j /values)., and collectively 
(via. the ; summation of the a ijV j=l, .V. ,n)v. Singul ar modeling 
ailows the individual alternative's/^ to 'interaction- 

effects to be input to. the decision ing model. Collective , mode --.. 
-ling then a 1 Tows the" impact to*, the total system of potential 
solutions to be comparatively evaluated against the established 
bounds of the conditional Jector. 




Computation of the Conditional (RHS) Vector 

^. the need to limit the constraint coefficient Sikions for a 
realistic simulation of. the system being modeled, as i/ell as the 
use of these same summations to detect system impact, should now 
be (hopefully) obvious' to the reader.' Jf one wishes to limit' W. 

. extent of some negative effect to the system v-ia 'the alternatives 
selected, then some upper bound is established for the sum of 
criterion coefficients which - represent this negative impact, 

Similarly, if the modeler wishes to force some' level of positive 
impact, a lower bound would.be defined for" the : sum of 'positive' 
.criterion coefficients, stating that this minimal sum must at 
least be attained. What may not be so clear yet, is how these 
limits are arrived at'. ' ,\- : * 

One of the authors has performed considerable research in the 
different ways to develop the RHS-values in the conditional.. . . : 
vector. These efforts have^produced two basic methods fon_ ' • 
generating the RHS (the first, static , meaning to be established' 
a priori , and therefore non-yaryi ng; the second, dynamic , meaning 
. to .be defined algebraical Ty within the model , the val ue(s') *■ 
varying as the model varies its search for a solution). *The' y * 
most common method is the static approach because of its' ease? an 
modeling and the acceptably ty of its assumptions. ..We will limft . 
our discussi on at this til? therefore; to the static RHS^val ue '* 
generation technique." •-. 

„ rN First -let us review what we are attempting to accomplish with 
the >i near inequality. Coefficients .have been' assigned to each . 
.<f- the alternatives-solution independent variables' (the multiple 
|alternatrye decisions being 'analyzed) , based upon the focus and 
; .intent of the particular criterion being modeled- (as a'. '■■'•'• 
constraint). Execution of. -the models will: 'sum various subsets of 
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the set of coefficients defining that criterion^ and will 
repeatedly compare that, sum to the R^S limit ass fgnefr; in the con- 
ditional vectors; that is: 



n 



a ij x j\l ^i ( negative impact). 



on, 



J=l 



' a i j x j L ^i • (positive imp ac . 



Recall .also that the fa. value is. to denote impact to the- system 
as a whole; that is, the collective impact of the subset of deci- 
sion al tern at i ves being eval u at ed v as a potent i al sol lit i on. If* we 
think of ^s a whole 11 and "collective; impact" in the arithmetic, 
sense, a useful analogy is the; arithmetic average or mean. That 
is, the system will average the co$£#ii^ 
analyzed; and compare this averagp;^^^^th the sum of the 



'coefficients," : . S^'Sfe- 



To* accomplish this, the modeler first needs to. predict' how 
many 'decisi6n,alternatives (x-) ; are likely. to ; be seleetfed for. the* 
final solution; let us say 1 k' . Then the modeler computes the : 
mean of the coefficients for a particular criterion, \ ' 



A i = tl 



m 
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and multiplies the mean valuS-A^ by the expected number f^ount ) 
of multiple solutions, ; . - 



.•where b i i?; the'-RHS-vatue to be compared with- the. .constraint coef- 
ficient (subset) sum. Thus,. \ ".■ **'•'' 



-3 = 1: 



where- the. ^number of.;a's approximate the* value of k. ! 'V, 

■ • .Unfortunately, experience show's the use of. the mean (alonef • 
to be substantial' , in establ is hi ng a Wor k abl "e b • va l ue t hi s 
problem is easily rectified by introducing the standard deviation 
.of the criterion coefficients to the b^ formul a. RSmemberi ng 
that' the standard deviation SD^ is obtained from:.- . : '•>, ' " 



SD A: = 



■ k.. '. 

we 



(A V - %»2 



n-1. 



fe. -can now .modify -the : b i gener at ion formula, as f ol lows': 
UPPER BOUND . bj . = k . '.(^ V 5 Da). ^ " V 



sUch that 
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a ijXj 2 k • (Ai +^Da) * 
j=l • ** 

LOWER BOUND b. = k • (ffj - SdJ) 
such that, 

n 

51 a ijXj I k • '(^ - SD^). 

. j=i ' * ; 

Use of the mean and standard deviation provides a consistent for- 
mat for constraining the dec*sion>ng matrix; and each constraint, 
therein. Not only is systematic flexibility afforded to the 
model as it searches, for *a unique (optimal) subset of solution 
alternatives, but the problems associated with initial system 
infeasibility are minimized/ The" ration of inf easibi l'ity will be 
covered in greater detail in a later section of this paper.' 

Cyclical Optlmatization Via Iterative Objective Functions %> 

In our earlier: discussion of the role of the objective func- 
tion (or cost vector) in gaining the frost optimal solution 
(decisioning alternatives subset) f rom 'the available feasible 
'solution subsets (acceptable to established constraints) , the 
reader may have become aware of the subtle b4as the "5 
OF-coefficients place upon the fiftal solution. Often, thi# bias 
is intended*. As often, however, it provides ''fuel" for model 
critjcs to attack the MAM procedure as another "computerize^, 
mathematical ly gerrymandering" technique. A satisfactory solu- 
tion to this 'potential' problem is available, and relatively 
easy to implement., * . 

' .> 70 



The idea of cyclical optimization involves *the cycling of 
each constraint entry (i.e. the coefficients afj of the 
constraint matrix) through the objective function. Generally 
speaking, this involves re-executin.g the model i-times, opce for 
each of the defined constraints where: 



C ij = a ij> 



? eac]i i-th iteration. 



Since we either maximize or minimize the sum of the 

Cj values! depending upon their positive or negative focus 

respectiv/ely, . cyclical optimization must be structured to then . 

maximize the objective function when the constraint values being 

cycled are of a ■ positive, impact 1 nature. And of course, the 

reverse being true for the negative-impact constraint focus. 

*. - 

The' MAM structure thus involves an#optimizatian strategy, * 
which may be depicted as: 



_ n • 

MAX 

c -hx,- for each i<th iteration 



MIN 



j=l 



1J A J 



n , 



subject to : ^ a 
J'=l. 



gXj («, =, >) bi 



C^j = a*j for all i of m; 
x j = 1,0 for some j of m. 

Cyclical optimization does not eliminate the bias of the objec- 
tive function; but rather r . allows each censtraint focus to simi- 
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lar,-Vy,_bias the result of the solution subset selection. > As we 
wi'll'.Vee- in a later section on "-solution teaching," the cycling 
of each constraint through the objective function provides a most 
useful^echnique for studying total system impact. 

Evaluation of the Magpie Alternatives Moddl 

~ ~ — : 1 

After rattier M&^l-ed treatments of the design and construe- 
■ • *#?>*f ,? ■ • 

tion of the W\M f^apework, additional discussion concerning the 

model's evaluation'^that is, implementation and execution) may., 
seem redundant to the reader^ Obviously, the model is designed 
in full acknowledgement of the way in which it will 'work' tQ 
select alternative solutions. , And the authors have gone to con- 
siderable length to indicate how the model will react to the 
various changes in its design and development. • , * 

But execution of the Multiple Alternatives Model is not in 
itself a "static" process. As a system of simultaneous linear 
inequal ities j varying configurations of the solution vector 
D*l X2 ^3 ... x p 3 will produce different interaction effects 
among the criterion constraint coefficients, effecting directly 
their sums and thus their ultimate comparison to" the established 
RHS-bounds. It is conceivable (and unfortunately occurs .often), 
that.;th^ initial relationship between the constraint matrix' and 
-cb'rtdjjtioQ^l vector produces what is known as an infeasible 
fegfbn . The model must then be revised by relaxing one or more 
o^pjthe constraint summation limits, in -order to determine 
.(ljjpate) an initial feasible space , and its associated parameters 

* values). Since the relationship between, criteria across 
rnatives ( viz ., interactive effects modeling) is not' imme- 
diately evident 'in an infeasible situation, considerable time can 
8 of ten be expended in* locating the "problem!' jWS-value (or 

tf 1tsK • . fc . ' ' ; • 



Execution also refers to a previously discussed notion of 
cyclical optimization; and the differing solution vector .. subsets' 
which usually result when the objective function isfcrepla^ by 
different values. The modeler must keep track of' the dif|ergpt 



solution vectors (thus the term; solution teaching ) and observe 
the nature of each cyclical-OF imp at upon the system's finale- 
sol utio(u ' '!'•.• — 

/». r 

If the above few paragraph's still sound like "Cicero's, ora- 
tion 'to the pretorium," then we have not errored by .ingludin|f 
this section. ' ' % Y 



• r » 

Total System Impact Via Multiple Competi.nef Constraints p # - 

'• * <•* 

* •• ■ '9 * «fc 

.in 

As each potential solution alternative *comp|tes with other 
alternatives for incli*sion»within a solution set, so al so ^oes 
any particular permutated solution subset compete with other 
feasible solution vector alternatives. * The*formation^of the 
optimal solution vectflr occurs as* the syste^i asks itself these 
questions during execution 1 : , 

(1) how many alternatives will ' occupy , the solution vector? 



(2) whifch alternatives will be selected? 

I 

(3) will these "(e.g. ) three alternatives better fit the 
constrained system optimally, versus these other five? 

(4) will in fact any combinational -permutation of the alter- 
natives being modeled satisfy^the constraints? • 

(5) which constraints "constrain" more than others? which, 
less? 
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(6) 



if the conditional vector.*, is comprised of desired 
impact," how ciojsfe can the model select an optimal solu ; 

tion vector, and minimize tha desired v..afctual 

* - . ■ 

*r * ■ . . • ' ■ 

( b t - 2L a ij x j) values? ■•• ■ ■ ; _ .."•./. j-; ,; 




what tradeoffs/preferences have been mad< 
criteria as a. whole, in the selection of 
solution subset "o\ter another. * 



id upon the 
iasible. 



Thus, "impact to the system being modeled is based, 
the selection of the solution vector subset and the re : ] 

terion constraints. It i£*'fchis complicated 'interrelate 

* J , . \ & ■ f-y 

' between •• al ter nat i ves and writer i a ( viz . , i nter act-iSMS &we&W®jS* v 

modeling) which makes thg^MAM' ah outstanding colter ion-;: 

referenced, decisionmaking tool . 




Initial System Feasibility and Constraintfffej;a^atib?) - 




the MAM framework cannot systematical^ 
subsets for an optimal / : conf i g u r a tj^tfi^b 1 1 fc^&fc eHi?%^4#J1 1 y has 



simply ;niean§^ that at 



been, initi ally established. R 
least one solution vector cbnfi^tra^'Tbh exi'^p^ whi ch wi 11, satisfy 
the modeled criterion cpn^tr a i nt^^l i near iViequ a>i t If no' 
such configuration exists- (that if, the solution veptw^ i§* a, 2^ro 
vector cO 0. 0 ..^ Oi, then the system is i.,'tfecl ared infeasible. 
Although subtle, the occurrence of a' zero-^e^or is a ^pst . import 
tant (albeit, frustrating) result 1 ; : . "■; 



If the system' has been .careful ly simulated and modeled via 
vali.d criterion- constraints , with the RHS-vaTues accurately 



. reflecting .sy^tiptf" n^eetls and/or demands ;T - then; the*' result of a; ^ 
/zeror-Vector sirftply means that no Alternative is acceptable tjo th6 



•system as a solution.' In most cases,; the model e^-v^u,ld r th.en 
"felax" one or, more of the modeled 8 constraints by ^ncr^asihg an '-' ' 
• upper-bQund and/or decreasing a lower-bound .. Suich c alteration < ,-• 
,niakes, tnb selection of some solVtion' vector easier" without ' 
violating a, constraint coefficient summation. However^ if the 
System modeled /( in reality), can neither reasonably p!6r ^r agonal ly " 



•.<■■ 



/'-.accept .the>el : axation.of its .""standards, and prioriti^,' 1 th^/: 

,; .{^modeled region is ^declared infeasible. 'The modeler mtist then - ., ^ 

\^;/^eek fc new potential split j on -alternatives to. be inctucfed^in -tte;.. .'. U ■ ; 

;-,MAM^framewor*k.; > But : if^ the earlier issue of the .collective- " ,\ 

w' exhay'ltiveness of. the -alternati ves has been addfe'ssefl* "thfe ' iy.stem ^ 
f;'>. vis/deciared - tflsb^liaibje. > '• -'l • V' i 

;,: ...ff'Cycl jca.V Opttmi'zation ? ahd Solutidn Tracking 



Cycl i cal. optinii zati on i s accomplished by uti 1 i z i rig f tMfe 
a^j coefficients; of each constraint *l3s the c^j coeff ici^jpt^ o%. 
thre objective fu'rictiQn. : Fpr • a.model with m-constr^ints, a max^' 




& 



mum pf m-executibns,' 1 each with m-diff erent sets of objective ; 
function coefficients, is possible. During any particular^ opti- : . a 
mizatidh cycle "the constraint .whose coefficients form the ^je^fe A 
tive function is still retained as a constraint -f dr. ;the /%v ^ H ^ 
.determination - of initial system feasibility. • \ ( 

Qui-te obviously (we hope) the reader now ponders the. f act> * ^ 
.tha^mfe^ (or "more appropriately, tn-optimizations): will 5 ^ ^ 

• prd|iic^. m-sets of optimal solution alternative s;- That is; gi verf v , : 
a fiv^a^ter native model, with three-constraints, the resulting ; > 
three cyclical optimizations courd result in the solution sets;. 
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4f 

.far. 



x 2 



x 3 



x 4 x 5 



o 

.1 
o 



0 

■1 4 



1 

0 

0 



0 

i 
0 



1 

0 

o : 



TOTAL 



2 
2 
1 



' j " ' TOTAL : ,. 1 1 • 1 .1.1 

'■Mm 4- > /_— ' - • •.: ■ - 

yffi&m'.i.' •' ' ' ■ ••' ; 

itfe' A^pii can see, the first two. cycles produced a solution set with 
^»v_ .t'twdf i' solutions' each; the third selecting a single alternative 
.r/icnly. What is more interesting (though suicide-provoking in 
$* v < real-life) is the fact, that each alternative was chosen once 
•Wjl'and only once) throughout the three cycles executed. Which 
v alternati ve(s) should then constitute the solution set? 



[? §;| v Suppose now that a different example' (and more realistic) is 
v |' posited, as follows: 



x 3 



x 4 



x 5 



Cycle 1: 
Cycle 2: 
Cycle. 3: 
Cycled: 

a 

Cycle 5.: 



1 
1 
0 
1 

0 



0 
1 
0 
0 
0 



0 
0 

1 

0 

1 



1 

0 

1' 

0 

1 



T0TAL 
1 



3 
3 
3 
2 
3 



TO^TAL: 



1 



This five-alternative, 5-constraint * problem has produced' a series 
of 1 3-3-3-2-3 ' solutions throughout the five optimization cycles. 
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More important (for now, anyway) is the total frequency wi|& 
which each alternative was selected as a member of the soMtion 
Set. This framework is very close to a vote casting situation, 
where each of five voters can vote for a maximum of three 
candidates. (We guess voter #4 is as frustrated as many of us 
are at election time.) Candidate #5 "picked-up" a total of five 
votes, followd by candidates 1 and 4.* Candidates 3 and 2 
acquired two and one .yote(s) , respectively. . 



Such a tallying of solution choice by constraint cycle is 
known as solution tracking ^ Each set of constraint values takes 
a turn at influencing the development of a solution set; at the 
end of which, a simple tal ly displ ays the proportion of total 
choice across all possible alternative choices. The novice at 
this point may decl are that ^option 5 is a clear ' choice; . and that 
1 and 4 should follow suit, forming the solution set: . 



[1 0 '0 1 



Depending upon the mutual exclusivity of selected alternative 
.solutions, we chose to agree amicably or dis-a^ree violently? * 



Mutual Exclusivity of Selected Alternative Solutions JL 
— " ; — §\ ~ ~ ;'-W v 

We have devoted an earlier section to the importance of $}r- 
mulating collectively-exhaustive alternatives (see P. 62) for. 
evaluation via the MAM framework. It was also expressed that the 
alternatives should overlap as little as possible (if at all); 
that is, the alternatives should represent clear, distinct 
actions- — no portion of which are included, within the domain of 
another alternative solution being 1 evaluaAd. % Such distinction 
is known as the mutual exclusivity of defined alternatives. 
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It remains ironic then, to now state that some multiple 
alternatives problems by their very nature^and substance, 
preclude such mutual ly-exclusive solutions.- At this point of 
ambiguity, the best teacher is an°example. 

Consider our earlier cyclical optimization illustration in - : • 
which the final composite solution vector was: • « 

' /. ' ■ ' r \ . /. 

* x l x 2 x 3 x 4 x 5 3 = C3 1 2 3 53 

Nqw let u^' place this solution into context. As a policy alter- 
native to the management of enrollment decline, you have chose to 
evaluate five elementary school sites for closure, based upon 
five a priori stated criteria. Being the intelligent and far- 
sighted person you are (you're welcome!), you decide to invoke 
the MAM framework to analyze these sites. The resulting .five- 
cycle optimization produced the above composite vector. What is 
your decision? ' ■ 

Those of us experienced in school closures (you can tell by 
the scars)' know, that the closing of one site may preclude a 
neighboring 'jeopardized' site from immediate closure, due to the 
transfer of students form the former to the latter school. Thus 
the choice of one alternative (e.g. site-)' may preclude the ' 1 
rational selection of another; alterntiave. This more situation- 
specific illustration of^ generic nonmutual-exclusiveness 
inherent in tl]e. problem, itself , demonstrates the need for the 
modeler to beware. 

.' . . ■ ' ' 

A 'solution to this problem is evident, however. Choosing the 
5th i site for closure, the RHS-values 

" .:. ■ ■ ■ . cs 

k ' (A i; + SD^) 



can be recomputed with i = 1, ,4 (S missing)' and tlje. problem . 

re-executed. Of course, the enrollments, of the schools neigh- 
boring the closed, site would be 'increased via transferred 
students; and criteria where enrollment was a factor, recomputed. 
Also, site #5 wotild no longer be a part of the model/ . 

Thus it is not enough, that multiple decisi'dnirig alternatives 
be, generated dtsti net from one another (mutual excTusiveness, 
input ) . Moreover, the individual entries of the derived solution 
set must demonstrate such distinction (mutual exclusiveness, 
output ).. V ' ' j 




VALIDATION OF THE MULTIPLE ALTERNAT IVES MODEL . 

~ : ■ : : ' =" — 

' . ■ . # ... 

•* . * 

As the final section of Part II and prior to commencing the 
development and, implementation of the sample R0LBAK I and ROLBAK 
II models, we woulc^be remiss in ignoring a most critical issue 
of the MAM framework; that is, "Does MAM do what ft purports to do 
~ the manner in which it is supposed to?" Sufch a demand for. 
accountability can only be responded to with/k most humble 
(though gratifying) Vyes.V 

Model Validity and Reliability Testing 0 

Validation of the Multiple Alternatives Model can occur only 
through its abil ity tb predict performances 'other thart perfor- 
mance, in itself ( viz . validity)., and the degree to which modeling 
results, (the solution vector) are consistent with purported per- 
formance (viz. reliabil ity). ' Val idating the execution and v 
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results of a mathematical decis ; ioni$gV model thus extends beyond 
the simple, notion of, measurement'. In effect, the modeling pro- 
cess must demonstrate at a minimum : " 

* (1) .that the decisiorf arrived at is indicative of the cri- 
. teria used.in the rendering of 'that decision; and 

(2) that the* criteria as a collective whole are "predictive 11 
of the resulting decision, j • v , 

For validity testing of the MAM system, the distributional 
characteristics of each criterion variable must be analyzed, to.} 
determine if a significant difference exists between the distribu- 
tion of the criterion measuring the .. "selected 11 .alternatives and 
the distribution representing the "non-selected" alternatives. 
If the criterion measures are interval or ratio scaled, the anal- 
ysis technique is simply a oneway analysis of variance procedure, 
where the independent variable represents whether the alternative 
was selected (=1) or not (=0) v The results'of this! ANOVA proce- 
dure wouM determine if the partitioned criterion distribution - 
representing the selected solution alternatives actually 
reflected the initial intent of the criterion constraint fociis.' 
If the criterion measures are nominal or ordinal scaled, the use 
of thg Chi-Squared procedure (with a (0,1) independent variable) 
is recommended. ■ , 

'/■' Reliability testing offers a new dimension to the validation' 
of decisioning mo.dels;, that is, the test of the modeled 
criteria's ability to predict future "choices" between multiple 
alternatives based upon . establ ished criteria inter-rel atiohships.. 
Thus in the results of a five criteria model, we ask the;" 
question: 
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"To. what extent do. relationships betv^eri/the criterion 
Variables (constraints) exist,: in .order to permit 1 a 
prediction of- future-^lution decisions based solely 
,. upon these same inter-relationships?''* 

Instead of a single dependent (criterion) and independent ' 0 
(dec.ision) variable(s), we, are now (in one example) confronted 
with a dichotomous dependent variable (0,1; to choose or not) and 
five, independent variables attempting simultaneously to explain a 
correspondence between selection and ^criterion aT.ues. This is* 
(obvio/sly?) the protocol for employing discriminant functions- 
analysis) ., Applying discriminant analysis, prediction equations 
(linear combinations) are developed to allow future decisions 
based upon the models use of the current, constraint criteria. 

, o '>■■ . , . t . .. J '- 

Validity testing thus reflects'the extent to which the MAM. 

solution vector reflects an appropriate partitioning of each of 

rthe vector's formulation.. Secondly, reliability analysis 

illustrates the degree to which the criteria relationships are so 

well .defined as to be predictive (collectively) of* solution vec- ■ 

.tor irjcTusibn versus exclusion. ?■ $ * : ' 

i '■ ' j ; . I . ■ . | . . 

Individual vs. Collective Criterion Ijjpact - ■ ' ■. 

We have reiterated many times* th^uperior (juality of. the/MAM. 
system in control! i ng for the JrtipactV ( and i nf 1 uencfe) of*: i rfteracA 
t^ve. .effects, /in . th<4* previous ^.5ection, aaalysis of variance . 
procedures were^f^ thecal idiAy : ..pf .decision. 

modeling per individual criterion .- However*, the MAM firamework ■ 
does -not exist iri a critenion-va'cuum, but rather supports a, \ 
collective criterion ^nf^uence unon decisionmaking. « The use: of 
, discriminant ^urrctions: to illustrate this coltledtive influence as 



a measure of reliability, is consistent with the focus and impor- 
tance of interactive-effects model inK 7 

A more detailed investigation is required qf the interactive 
effects by the multiple competing criteria because; of the addi-. 
tionaljjreliance upon cyclical 'Optimization and ttie result ia'g com- 
posite-generated solution vector. Only through the use of 
predictive^Tinear combinations, can. the true '^predictable" cri- 
terion ^impact be understood, r • v \ * '* 



Comparative Effect s from Main-Effects Model inq- 

. • 1 — " = — — • — • — - " :^ 



• An earlier discussion of the use of the composite variable ' 
ranking (CVR) technique (see page 21) in- analyzing potential : . 
solution alternatives, /introduced the 

approach to multiple aElternatfves. -^he resul ts from the CVR pro- 
cedure can be directly compared to the MAM results fpr .overlap. 
Indirectly, the CVR solution vector can be util ized as ; the inde- 
pendent variable to an ANOVA procedure, or as the dependent 
variable to discriminant functions. .The resulting statistics can 
then be matched against the- same statistics resulting from an' 
analysis of MAM results; ♦ and. the "differential impact" per - 
criterion, and collectively across all criteria* compared. ^ . * 

The reader is cautioned "-however to remember that the CVR - 
approach does not control for interactive effects. Thus. any par- 
ticular choice (solution) takes" into account only the measures 
pf the criterion' analyzed oVnjdividuailly. It is reasonable, to 
expect then, that CVR results may produce more agreeable ANOVA 
comparisons. The. "proof of the pudding" however will lie, in the 
matching of the results from the use of discriminant functions,.; 
when all criteria are taken into account simultaneously (which is 
•also reality's demand). ., * ■ . ' 
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ft Non*Neqotiabl^ /\ 

final ,£fcnment before. displaying, ttfe actual results of two 
! MAM applicatior>s..i.n a fiscal roll -back context. You might ask, 
why go to all this trouble in order to analyze a multiple' alter- 
nativ ' es ^situation? 'Clearly, a great deal of effort is required 
;. to •de^ftethe-^r^er^' measure and input 'them to the 'itrodel f ' Is 
j it all worth ^it?. And if . so, why? : " 

^ n ^^-^ii^? on ' s v ^9 ue ' ambiguous /and- otherwise 'wishy-s 'j'i 
' ■ ^^^^^^P^|^^]K^<^^^tbiTi ng' might 1 ead'the casual observer to 
. be ^^?tfrat tfile resulting decision can likewise, be non-speJiic. 
•"hi left* is may' often -occur, the actions derived from-'the deci 
s}ons^£n not ;-themssaTves _be vague'lal though they may be 
4ncoher|nt)* : And the .results ^ these actions. will. .not be ambi- 
. guous Ct|ough they nray provide worthless or even disastrous). 
Deci s i orvjfak i rig", especially in the multiple alternatives arena, 

' S n -y^^ people 
•>lead ojtw^sJt : o ,: believe. " > ' • 
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; >■ Mltty ahly be rational ly 

■ accomplishe^ia the use- of defined criteria; and the. conscious 
control of t%. criteria's competitive- interaction. , If you as' a 
deci;s>i'on^^ can aecompftsh' this' saccessf ully whil,e discounting 
the MAM 7r^e4|rk> we- are most humble. impresiflBk However , ,if 
having read®! previous pages. -you" can now recognize. the . " , 
eompl exi ty of mul ti pi e al ternati ves deci si oning , and the requi re- 
. ment for ; a structured framework in which to evaluate these alter- 
natives we rest our Ccjse! y_ . ' 
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PART III 



FIELD APPLICATION OF THE ROLBAK MODEL'' 
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INTRODUCTION" TO THE' FIELD APPLICATION 



Part III now prepares to address the issue of actually 
operational izing, the claims of the first and second parts. That 
is, can a structured decisioning*system be formulated to evaluate 
'the^rspecific criterion-referenced alternatives of various program 
Llnits for fiscal roll -back in a budgetary crisis; and can such a 
Critter ion-referenced, muHiple-altenriat'ives model be utilized 9 
'confidently in a funding deallocatioV situation? 

The authors have had the distinct (though unfortunate) 
advantage of residing in a state which now finds itself in the 
midst /of ' a severe, financi al emergency.., In al l sectors of .-. . 
educatiorv^from the state policy level to the realm of the 
classroom^ teacher, alternatives are now being studied to brace 
for a cut to state-support for both K-12 and post-secondary 
education. To present t'he design and utility of the ROLBAK 
formalization, a single school district has been selected for the 
required piloting activities to demonstrate the ROLEftK v 
formul ization. , . ■ • ' 



Need for the Research ^ 

7 ■ • . ■ 

In an- age of expanding technology, the role* of sophisticated 
approaches to decision-making has become' more accessible to^the ^ 
field administrated. v Nothing supports this view more strongly 
than the recent advance of computer technology in particular. 
Yet, those individuals who* could best afford the advantages of *' 
such sophistication remain the greatest obstacles to the accep- 
tance of sophisticated tools / as a beneficial tool for data' analy- 
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J sjs, and evaluation- Tfre situation surrounding the funding 
deallocation of specific programs -is a clear example. t . 
' ■ •» ■ *• . •* ■ 

Scant resources* require a revision of expanding service 
activities. Compounding, the problem of forced decline is the 
fact thar many years 'of affluence in the availability of wide, 

' diverse serv-ige delivery now clouds the issue of which services 
laref essential and which are a luxury — that is, the difference 
between entitlement oh the one hand, arid enrichment on the jother. 
Therefore, the evaluation of current operating programs for 
possible* el imi nation (or reduction) will" not onjy require . , 

- assessment of performance, but also a measure of the program 1 Sr 
demand and need. As* the becj si op-maker adds the criteria of nee£k 
and demand to the already generic criterion Tist of j 
effectiveness, efficiency, satisfaction and expenditure, the role 

• of a multiple alternatives formulation to" determine programs for 
retention vs. reduction via an' analysis of multiple, competing 
criteria becomes paramount., 

Finally, the need for a demonstration of a criterion- 
referenced, multiple-alternatives decisioning model is dictated 
by the parallel need of due-process . Not only does the decision 
-maker need to be convinced of th(e eff i cacy of a careful ly for- 
mulated MAM framework, but the program participants themselves 
. need a firm understanding of the modeling perspective. People 
affected by the model-generated solutions (in this case, programs, 
to be terminated) must accept that their personal interests were 
part of the' decision, and that the relevant criteria were taken 

'into account in the preparation of the final decision. \ 

/ . v 
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Purpose ofi the Research ^ i^^^m^ 



*The mission of thi s^^^^g^ng is t^o-foid; first, to. 
demonstrate the* devel °P me ^^^ °f the multiple-alter-^ 

natives analysis framework' fp^^ffllrea of fiscal roll-backs;. * 
and second, to assess the, rele^^wssues of "decision validity 
and model reliability for th'e reader and p6tent;ral user. We as 
scientists fully realize, that ^^feptance of -our .technique can 
reasonably come only after m^xi.tf^* critique^id s'crutiny. ;We 
have endeavored to step-by-st6p(^notate the development of the 
ROLBAK model Tor this particular study- And, we' have "employed 
the use of parametric statistical procedures % in' r order to assess 
the model 's impact upon the task at hand. r > ^ 

That task is this. Given an existing district program of 31 
individual and distinct units, artd the posts involved -^-prepare,; 
'execute and evaluate the results of a, mathematical. modeling pro- 5 * 
cedu^e which utilizes a criterion-referenced base for determining / 
which program units remain operational, and which program un.its 
must be discontinued. , • ' t 



the. criteria involved represent the identified expenditure 
• requirements of each program unit;', delineated across the eight 
"object" categories of a program budget; apd a single measure of 
subjective opinion on the part of :entral off i c'e administrators 
as to which units are more important., than others. We limit the 
inclusion, of criterion references toDnly nine indicators for 
convenience only . Many'other measures must be included in the 
final determination of units to be deallbcatfed. However; the 
'demonstration of the model 's utility will not require the loading' 
of all relevant criteria into this pi loting-formulated model. 
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.' Overview- of the Research . • . •.. 

/The outline for the .contents of Part III. have been 
. * constructed to accommodate <a chronological discussion of the • 
• R0LB%^pdel/« design, .data construction, execution, -ar\d, post-hoc 
eva-l'uation. • 'V' * •/ '*. '• 

• The follow^ig section d$als with the construction of the 
database for subsequent MAM-analy^. The ^ext two. sections will 
. tfieo present .the rationale and methodology for utilizing the T- 
;iriormal transformation of the new-scaled measures (dollars of • 
v- : .\e-^)enditure). In addition,* a brief discussion of special -cdn- 
;.:Si si eV* at ions in : dealing with scant matrices' wijl 'be presented.* 

The fifth sedtion deals entirely with the search for initial 
model feasibility -- that is, the identification of the correct 
mix of constraint values (RHS) to permit an initi al solution to 
th§ model; ' v ' 



/ .The next^two sections present the results (solutions) deve- 
loped' through the use of "restricted 11 and "relaxed" models, 
respectively. These two. sections have been developed Separately 
to highlight the differential impact 0 of weighting. * t - 1 

j< The final two sections provide both Y comparison ; of the : 
restricted versus relaxed solutions, and a generalized discussion' 
■of the total ROLBAK performance under ^analysis. , • . 
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CONSTRUCTION OF THE DATABASE 



Although an actual field appl ication (i .e. "for. real") of 
ROLBAK to a fiscal emergency v^ould necessarily include many cri- 
terion references to effectiveness,' efficiency, need, demand, 
satisfaction and expenditure; the authors have limited the pilot . 
of ROLBAK to a small aggregate of measures * Under the broad 
title of 'database' will e^st the numerical values required to 
operational ize the functions of the constraint matrix, con- 
ditional v§ptor (jlHS), and the objective, function- , Finally,'.-/ , 
three 'distinctly different scales will be used to demonstrate the 
versatility of the model's* dara-input requirements. . ' * 



Source of Data ^ 



ERLC 



\ Data for the model's execution represents two generalized^ 
measures: (1) a measure of expenditure requirement^) v in , 
t ho us anils of dollars; and (2) a..measure of subjective bias, 
ordinal ly-scaled in units of rank (i .'e. , 1,2,3,...)- 

The expenditure/data is input to the model" -in two separate., 
• fashions. The r first, segregated by object-category, provide a 
eight (8) separate' expenditure amounts' for" each of -the program 
^- units under consideration. These object categories are? defined \ 
w as projected allocations for: 

. 1. CERT - certificated salaries 

2. jCLAS - classified salaries 

3. BENE - employee benefits ' * » 

4. SUPL * supplies and, materi al s 

5. INST Xinstructionalysuppl ies 

' 38 
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. > v. * ■ ■ ,"■ - 

"15. CONT - contractual "services 
- 7. TRAV - travel expenditures 
8. CAPI - capital 'outlay 

These measures (originally in $1000' s) will be later transformed 
into T-normal -scores. Secondly, ajcategory^of 'total 
expenditures' required will be input to the model.' Tjhis par- 
ticula^ constraint will be utilized to efficiently control the 
'cutting bias' of the model execution. . , ' • . 

The second, general input manner will be an ordinal "rank, of. 
perceived expendabi lity" attributed to each .of the individual- 
program units. Central office administrators were directed to 
rank the programs under consideration as to their degree of rela- 
tive expendabi lity, with 1 = most expendable. 

■ * 

For this 'particular ROLBAK pilot, a total of 31 programs 
were evaluated to determine the membership of 'the target set for 
deallocation.- The criterion indicators to perform the MAM analy- 
sis included eight measures of object' expenditure and a measure - 
> of perceived expendabi lity , as well as a measure of composite 
expenditure. < ^ 

& » . ■ ■ • 

Method of Data Generation , 

Total projected expenditures for each of the 31 identified 
program units were delineated into 8. object .categories, as 
.available from district office budgeting records. The rank- 
measures of perceived expendabil ity portray composites from the 
aggregated ranks of four staff members: superintendent, 
assistant superintendent, and two administrative assistants. 
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In addition, the eight objects were summed to provide a 
measure of project^ total expenditure by unit. The^tility of 
this composite measure will be discussed in a later section. 
Where no expenditures were rioted for a. parti cular^program under a 
specific object, the value of 0 (zero) was assumed. Such zero- 
cells form a scant (or sparse) matrix. Necessary controls for 
the analysis of scant matrices are discussed in-the succeeding 
two sections . 



Matrix Formating for MAM Utilization 

.Tigure 8 displays the raw database to be transformed to TV 
•normals (see next section) and subsequently evaluated by the MAM 
procedure. Note that the model will incorporate 10 criterion 
measures for analysis: expenditure by object (8)., total expen- 
diture by unit (l)pand perceived expandability (1). As will be 
discussed in a later section, the total unit expenditure criteria 
will be utilized twice under actual model execution: once to 
establish 'a level of minimal cuts, and the second to provide an 
upper Ijound on the model 1 s. 1 cutting 1 (we did not want the proce- 
dure to go "wild") . 



) 



Recall the reason for the [database described in Figure A. : 
These "TneSsures will guide the wLBAK analysis in determining 
which units will be allocated v$. deallocated funding -- based 
not' only upon their expected expenditure by object but also upon 
their degree of perceived expendabi lijy. In addition, the 
measure of total unit expenditure (across all 8 objects) will, be ' 
utilized to control for determining when "enough cuts"\have been 
made to balance the new budget limitations. • ^ 
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Figure 8. Initial Raw Data Base for T-Normal Transformation and Entry into ROLBAK Procedure. 
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y IN ITTAL T-NQRMAL TRANSFORMATIONS 

r ■ y. ■ 

1 . ; 4 ' * 

One of the original directions to this paper was to present 
the versatility of the*MAM framework to accept a wide array of 
measarement scales as indicators for^the values qf the criteria. 
( . Although not discussed at length, all scales (i.e. nominal, 
ordinal, .interval and ratio) can be accommodated by the MAM- * . 
model . * , 

In addition, the MAM framework in general and ROLBAK in 
particular, can be structifred to model one of two situations (or 
both) concerning measured impact: impact of the system modeled 
specific to the ^individual effect for each alternative's value; 
and impact to the system modeled generalized to\the collective 
effect for all alternatives' 1 values." Briefly, the need for 
control of specific, individual effect (the former) addresses the 
need to measure the utility of each program alternative, and its| 
absolute ability to coexist with other alternatives as part of 
the solution set. The use of a control for generalized, collec- 
tive effect (the Tatter) however, addresses a less rigorous need 
to measure tffe utility of a program alternative, and its rel ative 
ability to become a member of the solution set. 

Extensive research has been accomplished over the past five 
years by this author to understand the implications of a 
generalized', collective measurement system for criterion eva- 
luation and control. Specif i cal ly, 'this research has centered 
about the usefulness of standardized (normalized) measures to 
accomplish this collective controT need. Early-work with z- 
•^scores was satisfactory, but^ required vigilance for the arith- 
metic impact of weights beneath the mean, that is, the negative 

values of z-score. Conversion to T-normals precluded such* " 

« 
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Concern, and forms; the primary measurement scale for the objer^ 
expenditures in the ROLBAK model. > 



The i^s-e of standardized measures allows the decision-maker 
to measure the. relative impact of each criterion's weight (for 
each unit alternative) without being concerned about the specific 
dollar amount. Reliance upon relative impact via the "objept" 
criteria is valid within the ROLBAK system, since an additional 
criterion of total expenditure for each /program unit is present ~ : 

Transformation Considerations for a Scant Matrix , . :\ 

: ; • _ 7 ^ ' a f 

# ,Bef ore proceeding with a specific il 1 us^trat ion pf normal i zed. 
transformation/ we ; add a cautionary , note concerning data matrices 
with a high number of empty ce11s r Empty cells normally mean one 
of two things: either* the, measure was° 'zero 1 , and therefore a 
zero was entered; or the criterion was \ inappropriate to that par- 
ticular alternative, and therefore no measure is possible. As we 
said much earlier, the choice of relevant criteria which are / ? 
applicable, across 'all alternatives will preclude the model - "' . 
builder from the need to control for sophisticated confounded 
effects from irrelevant criterion variables.* : 

For ROLBAK, the amount of zero-cel Is demonstrating. zero-cost 
in -particular objects for certain alteratives is. very large 
large enough' to call the : data, matrix a "scant" or "sparse" matrjx 
(more zeros than not). To control for this situation, and to ■ 
provide' a better environment for the use of the RHS' control 
values, we chose to exclude the empty cells from calculation of 
the normalized measures. ' ; ' 

'. 
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This" is to say ( please read very carefully now), that: 



the normalized, values* associated with a particular 
crAeri'onQdemonstrate the - relative weight of that cri. 
terion for the individual unit, relative to the other 
unit 'weights where such criterion expenditure actually 
' exists; , . 



"(You can 'stop reading carefully now!) 

In effect, the?zero weights denoting no expenditure'^are not 
part of the original distribution' that- will compute -the standar- 
dized measures; arid. -thus .the calculated weights will be^more *con 
versant with- the other unit values where criterion expenditure 
actual ly«6xists. 

. . . D 

Fi rst Stage Transformation to Z-Scores 

fhe. following subsections are presented in brief to help 
those readers who i&ve' misplaced their statistics knowledge (who 
•has>nx)t? j. /' * ■ "*\ . ' 

A. z.- sco re is a normal ized measure, standardized to reflect 

the relative weights' of each of the 'raw data 1 values which form 

. t v - : 

% specific distribution of scores (in our specific case, the , 
distribution of expected expenditures, by object category). A z 
^cord£represents. the mean of the raw distribution as a^'O.OO', 
and the standard devi atipn as 1 a '+1.00'. That is, a raw score 
which represents a single standard deviation above the mean of 
the distribution's computed as a +1.00. If, a score -is one and 
one-i^alf £imes' the standard deviation below the mean, it. is. 
represented as -l'.5@; and so- forth. - **. 
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This' is to say ( please read very carefully now), that: 



the normalized values associated with a particular 
cr Aeri'onQdemonstrate the - relative weight of that cri. 
terion for the individual unit, relative to the other 
unit 'weights where such criterion expenditure actually 
' exists; , 



% (Y6u can 'stop reading carefully now!) 

In effect, the?zero weights denoting no expenditure\are not 
part of the original distribution' that will compute -the standar- 
dized measures; arid. -thus .the calculated weights wili be^more *con 

* • * 

versant with- tjie other unit values where criterion expenditure 
■ ■ « \ ■■ jf . ■ . 

actual ly«6xists. 

• < J) 

First Stage Transformation to Z-Scores 

/v. . : : ■ f 

the. following subsections are presented in brief to help 
those readers who i&ve' misplaced their statistics knowledge (who 
•has>nx)t? j. /' >' ■ "*\ . ' 

A. z.- sco re is a normal ized measure, standardized to reflect 
the relative weights' of each of the 'raw data 1 values which form 
% specific distribution of scores (in our specific case, the ; 
distribution of expected expenditures, by object category). A z 
^c.ord£represents. the mean of the raw distribution as a^'O.OO', 
and the standard devi atipn as 1 a '+1.00'. That is, a raw score 
which represents a single standard deviation above the mean of 
the distribution's computed as a +1.00. If /a score is ope and 
one-i^alf Rimes' the standard deviation below the mean, it is* 
.represented as -l'.5@; and so- forth. r J \ 
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For the zealots among you, the transformation formula for 



computing a z-score from a raw distribution is follows 



z i = 



X. - X 



where, 



Ih 



and, 



s = 



£(X 1 - X) 2 



subject to, 



N 



(standard deviation) 



i , - 1,2, . . . ,N values. 



Second Stage Transformation to T-Normals 

The use of T-normals is simply suggested as a useful tech- 
nique for circumventing the negative values of z-scores (or 
z-normals, if you wish). T-normals are standardized measures, 
with a mean of 50.00 ancj a standard deviation of 10.00. Thus, 
negative T-normal would result only from a raw measure-, ..whose 
value resides greater. than 5 standard deviations below, the mean 
of the distribution (somewhat unlikely, in the usual case). 

T-normals are computed directly from z-scores, as follows: 
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T i = 10.0^ ) + 50.0, 

such that a z = -1.0 bfecomes ; a T =! 40,0, a z = +2.5 becomes a T = 
75.0, and so forth. ■ - • 

FORMULATION OF THE ROLBAK MATHEMATICAL MODEL 

►The- reader -is-d-ir-eeted-to-F-tgtnre'7 (see page 61) to review 
the format of the generalized MAM framework. Recall that the 
model utilizes three distinct though obviously -interrel ated 
segments. The first, the constraint matrix, contains the coef- 
ficients for the system of simultaneous linear inequalities (and 
equalities), whose independent variables are the alternative 
program units. Therefore, these coefficient values are really 
the criterion measures associated with each independent 
variable's "performance" or "need". 

h * - . , 

The second distinct segment, mthe conditional vector (or 
"right-hand-side"), contains the 'Composite measures which 
restrictfthe summations of the coefficients of the independent 
variables, as those independent variables are evaluated for 
inclusion within the final solution set. These RHS-values are 
the upper (or lower) bounds associated with the linear 
inequalities, and the exact standard associated with any linear 
equation. 

The last segment, the objective function, provides the 
guiding force behind the selection of alternatives for membership 
within the solution set. Remember that objective function 
(sometimes referred to as cost vectors, whether measuring cost or 
not) must be either maximized or minimized, depending upon the 

— : : — : — — ^— — : — 
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objective of the problem modeled. Maximizing (or minimizing) the 
summation of tke objective function is/referrecl to (in 
fashionable circles, of course) as optimization. 

Under optimal ity then, the goal of the model is" as follows: . 

to formulate the "best" solution mix of alternatives 
based upon th^ values of the objective function; given, 
the con^^P^tS- defined, by the'sTmultaneous system of 
inequalities (and equalities) as modeled by the 
constraint matrix, and the limits provided by the con- 
ditional vector. 



The Constraint Matrix ' 

To formulate the ROLBAK problem, a total of 31 individually 
funded programs were defined for evaluation. Each program's 
budget was delineated into it's individual 'object expenditur.£ J ---y 
requirements (certificated salaries, instructional supplies, 
etc.). These^initi al eighf expenditure breakdowns form the first 
8 coristraints of the constraint matrix; apd are entered as T- 
normal transformations. The next two constraints are identical 
vectors containing the total , .composite expenditure requirements 
for each program unit. Expressed in thousands of dollars, these 
two vectors will provide the basis for controlling the model's 
final, total amount of final deallocation. The last constraint 
vector, in the matrix, contains the ranked values for the 
"perceived expendabil i ty" of each unit; where 1 = most expendable 
and 31 = least expendable. 

Thus the criterion coefficients of the constraint matrix 
represent three distinct measurement features: T-normals 
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*s . . . 

measured ~in standard units, total expenditure measured in 
thousands of dollars, and expendabil ity measured in ordinal 
ranks. 

Conditional Vector for a Scant Matrix 

^Jhe RH S- ya lues . of the conditional., vector served to, opera- . . 

, " tionalize the simultaneous system" of the constraint matrix; that 
is, they .establ ish the limits which the vector-coefficients sum- 
mations must comply with. 

For the initial: 8 object-expenditure constraints, the 
RHS-values are computed to effect a "general ized impact upon the 
system as a whole treating all objects equally . Thus, expen- 
ditures projected in any one category do not place their assoc- 
* 

iated programs in weighted jeopardy. Although in some modeling 
cases such weighting will be desirable, the current example 
weights all equally for demonstration purposes. These specific 
values will be discussed at length in the next section. 

/The next two* constraint vectors are identical in that their 
coefficients represent Composite object expenditures for each 
program. The district's current operating budget comprised 893.5 
(thousands) dollars. The goal of the model was to develop a plan 
for effecting a revised operating level of not less than 675.0 
dollars (1000' s) nor greater tjpan 7Q0.0 dollars (1000' s). To 
model this objective (constraint), the sum of the first vector 
.was limited to 675.0 (greater than or equal, and the sum of the 
second vector to 700.0 (less than or equal). In effect, this 
"bracketing" allows a 25.0 dollars (1000' s) flexibility factor 
for model evaluation. , 



' " •'" •••• . .. ... . * 
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The final constraint, the measure. of perceived-expendabi 1- 
ity, was modeled to effect a smaller sum (minimized). This was ' 
necessitated due -.to the fact that' a smaller. rank represented*, 
greater expendability — .and thus, the sum. of smaller values pro- 
duces a "preferred 11 smaller .amount. 

The considerations required for a scant matrix involve only 
the firsts inequality vectors. However, the sum of zitvi will 
not deter from thi utility of the .conditional vector jnsuccess- 
fully controlling the sum of * the remaining sums. Since the empty 
cells represent no expenditure for that particular object, the 
choice of the associated program unit will not contribute to the 
RHS-requirement (limit). (Again, please refer to the next sec- 
tion for a more v detailed discussion.) 




Cyclical Objective Function ■ ^ 




Since the construction of the objective-function, and/the 
subsequent .maximization or minimization of its sum, defines what 
we call' 'optimal ity' , the content to the O.F. is a biasing factor 
to the model 1 s evaluation of alternatives. It is reasonable to 
expect a different mix of solution alternatives, if the model 
utilizes a different objective function _or changes from maximiza- 
tion to minimization of the same objective vector. 

ROLBAK examines the effect such manipulation has upon solu*- 
tion results by cycling each individual constraint vector through 
a separate execution as the objective function. Moreover, the 
focus is altered to investigate both optimal ity directions, maxi- 
mization and minimization. 



99 



113 



The Problem * 

Given the structured the MAM framework discussed above, 
the resulting ROLBAK' model Will select (X. =1) those program 
units to-be retained, that are to receive funding. 

i 

« ■ . 

B SEARCH FOR REGIONAL FEASIBILITY AS BENCHMARK 

The initial attempts in executing" a MAM-designed solution, 
requires the establishment of first , initial region feasiblity of 
.the decision space, and second , a benchmark from whicji the mani- 
pulation of RHS-weighting and cyclical optimization can both tye 
measured. Decision space (regional) feasibility simply means 
that at least one solution exists which satisfies the require- 
ments of the constraint matrix and conditional vector. If no 
solution exists^ under any circumstance allowed by the linear 
inequalities and equalities,' then the decisioning (constraint) 
region is declared to be "infeasible 11 ; and the model either 
.altered or abandoned. ■ < ' 

Once feasibility is determined, a benchmark is established 
to begin the cyclical evaluation of the various agreed-upon cri- 
terion yalues. The benchmark may in fact ^ the initial point at 
which feasibility is determined. However, serious practitioners 
of the art (obviously us!) will search for two separate model ing 
configurations from which to observe the effect of the. varying 
optimality criteria. These separate configurations can best be 
addressed as states of restriction and rel axation. 
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The restricted model contains RHS-values which force the 
executionito choose its solution set most carefully; that is, the 
limits imposed are very restrictive as to whfat'is allowable to 
constitute a solution. On the other - hand, the^relaxed model uti- 
lizes such RHS-values as will invite solution set membership pat- 
terns which widely differ. The authors have chqsen. both so as to 
please even the most skeptical of our readers. * * ' • x "' 

* 'N' of the Scant Matrix . 

- ■ ^ 

The normal procedure in attempting to establish feasibility 
is to arbitrarily project the number (N) of solution which is 
likely to result from the successful implementation of the mo'del. 
With the use of T-normals, and the given T(mean) = 50.0 and 
T(standard deviation) = 10.0, the arbitrary N can'be used' to 
establish a beginning RHS-value: » 

y ' 

; fV N(50.0 + 10.0) = N(60.0) s 

for a perceived upper bound; and: 

* N(50.0 - 10.0) = N(40\0) : 

-for a percei W Jower bound. (The rationale for such con- 
siderations has been discussed at length in' a p're'vioife chapter of 
ttas report.) 

The existences of a scant matrix however provides a rather 
unique situation concerning such 'N' formulation. That is, the 
N's concerning each criterion across all alternatives will 
differ,' based upon the number of empty (i.e. zero)^ cells. And in 
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fact for this particular ROLBAl^ formulation, this is Exactly the 
.case. Referring' to Figure 8 (on page 91 ), you will see that the 
number of non-zero cells are as follows: ' 

' * " • CERT =12 

CLAS..= .lo ' V ■ _ 

' , • BENE = 8 

' ",' , - • SUPL - 14 • 

' • • , . . INST = 10 • - ,, 

CONT = 14 
TRAV' = 2. 
CAP! =18. 

Under these circumstances, the useful relationship of 
" •, . N(T(Mn) + T(S.D.)) 

must be changed to 

N k (T(Mrr) + T (S.D.)) 

for each separate k = 1,2,..., 8 of the object expenditure 
categories. 

i * 
Expected Solution Index 

,The expected solution index (ESI) controls for both the 
existence of a scant matrix of zero-cel Is, and the necessity to 
investigate varying levels of solution N's — that is, -the number 
of units which may >be members of the final solution set. 
Although inextricably related, -we will develop each separately 
for the sake of understanding their unique contribution;, ; % 
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•The existence of a scant matrix will provide a varying 
number of non-zero cells. Jo operational ize the utility of the 
N(T(Mn) + T(S.D.)) idea, we must vary the N for each computation 
of the particular RHS-value/ Furthermore, the region of feasible 
solutionis) will likewise require the search for a suitable 
(expected) solution set size; that is, to allocate (for example) 
funds to 10 programs; or 12; or 14; ,etc. 




The EIS is calculated to take into accouh* N both scant matri- 
ces and .varying solution set membership by utilizing the postulate 

(N > 0)(E) 
N(total) 

where, 

CN > 0) = number of~non-zero cells for the given 
criterion constraint; 

' \ (E)* = number of expected solution set 

alternatives; and 

N(total) = number of total possible alternatives. 

a i 

In our ROLBAK example, this expression can be reduced to 

(N > 0) (E) .. • . 

31 

....... — , . ^ m . 

For example, if we were to examine the ESI for the "certificated 
salaries" constraint (12 non-zero cells) and an expected solution 
membership of 10, .the index based upon the (N > 0) would be calcu- 
lated as: 
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I N>0 12 

1 = 4£ = .387 , 

3i . it + 



•and with the expected membership (E) of 10, 



31 \E) =.. 397(E) = .387(10) * 3.87 

This index and its relationship to tfoe T-normal values will be 
described in the next subsection. 



RHS-Values by Index 

..... "U 

Figure 9 summarizes the calculation of RHS-v^lues utilizing 
the idea of an expected solution index (ESI) for a scant matrix, 
for example, given the constraint of certificated salaries ' 
\cERT), with 12 non-zero entries' and an expected solution mem- 
bership of 10 units, the RHS-value"would be computed as: 



12 ^ 10 ^ (50.0 r 10.0) = 3.87 (40.0) = 155.0, 
31 



assuming that a "linear bound" is the desired RHS intention. 

The RHS-values for PERC and COMP are arrived at arbitrarily 
as well, but without resorting to the above scheme for T-normal s. 



Search for Feasibility 

Use of the ESI system discussed in the preceding subsection 
established immediate feasibil ity, 'with concurrent values for 
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Figure 9. Computation of Condi tionaf Vector (RMS) Values for^onstraint Matrix 
with Zero Sub-Matrices and' Cell-Entries Based Upon T-Normal Scores 
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PERC and COMP as shown. Any value for PERC less than 500, 
however, lost the feasible region. 



Search for B enchmark * 

V — - 

1 • . . " " 

The range of expected membership ' values was varied from^E = 
10 to E~= 16, and the def inition(s) of rel axed benchmark attached 

to: , ■ " . 



E = 16; PERC = 500, 
and restricted benchmark attached to: 

E = 10; PERC = 600. 



Since the object categories were constrained to force sum- 
mations -greater than or equal to the RHS-values established by 
the ESI, the larger the RHS-value, the more difficult to find an 
acceptable solution,— therefore, the more restricted. Likewise, 
for the relaxed system and smaller values of the RHS. 

For the purposes of the remainder of this chapter, "the. 
restricted and relaxed benchmarks will be utilised to observe the 
effects of cyclical optimization upon solution/set membership. 



CYCLIC OPTIMIZATION OF THE RESTRICTED MODEL 



The first of two major quantitative assessments, the cyclic 
optimization of each of ten (10) criterion linear (convex) com- 
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bi nations as the .objective function, produced analyzable results 
^ under ^ot^ maximization and. minimization. This section will 
study the$e results, and address their relationship to both thg 
model's execution and the criteria utilized, for the restricted 
model. 

Maximized/Restricted Solutions '* ' • ' 

Figure 10 displays the results of the various .cyclical maxi- 
mizations within., the restricted setting. Of the. possible com- 
binations of the available 31 units for solution membership, 'only 
two distinct solution, sets were formed. The mix. -set of 10 ' 

entries - 

. <\ • * 

t 01,02,03,04,05,07,09,11,15,17 J " ' 

produced a new budget of 680.0 dollars. (1000's) for a savings of 
213.5 dollars (1000's), in five cases. Similarly, another five 
instances formed the mix set of 10 entries ,/' . 

I 01, 02,04*05, 07,11,15, 16, 17,23 3 

producing a new budget of 680.5 dollars for a savings of 213.0 
doll ars . 

^ Additional technical data has been .included/within the 
figure for the more technically knowledgeable. 
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Figure 10. Effect. Upon 8udget Deallocation Decisions 8 ased'Upo* the Variable Flows of a Cyclic Objective 
Function, and the»lnteraction of a "Maximized, Restricted 1 * Constraint Iterative Problem. 
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Figure 10. Effect. Upon 8udget Deallocation Decisions 8 ased'Upo* the Variable Flows of a Cyclic Objective 
Function, and the»lnteraction of a "Maximized, Restricted" Constraint Iterative Problem. 
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Minimized/Restricted Solutions 



Minimizing, the various objective functions 'within the 
restrictive setting produced similar results (Figure 11). Four 
occurrences. of the solution vector 

l 01,02,03,04,05,07,09,11,15,17 a 

and three occurrences of the solution vector 

C 01,02,04,05,07,11,15,16,17,23 J 

resulted' in the minimized, restricted setting. Unl ike maximized 
optimal ity however, the use of minimized objective functions 
failed to produce a solution in three, separate instances. 

Validity Evaluation of the Restricted Model 

Analysis of variance procedures were 'utilized to detect the 
extent of criterion difference between membership in the solution 
vs;. non-solution sets. Since" optimal ity within the restricted 
setting produced only two different combinations of solutions, 
these post hoc assessments were easy to execute. Results are 
presented. in Figure 12. 

A review of the ANOVA results show that in all cases except 
one, the mean values of the "included 11 criterion indicators were 
greater than the non-solutional weights; and were therefore con- 
sistent with model expectations and formulated constraints. The 
one exception occurs in both optimality settings when the percep- 
tion of expendabil ity was used as the O.F. 
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Figure 11. Effect Upon Budget (Deallocation Oeclslons Based Upon the Variable Forms of a Cyclic Objective 
Function, and the Interaction of a "Minimized, Restricted" Constraint Interative Problem. 
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Figure 12. Summary of Cyclic Optimality Directions (of Criterion Objective 
Functions) Utilized 1n Guiding the Fully Restricted (EXP=16; 
PERC=500) Problem to Two Distinct Solutions; and Resulting Object 
Expenditure Impact. [ 

Fully Restricted (EXP*16; PERC=50Q) V 
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(P=) ... statistical significance of mean difference, include v. exclude. 
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It is also -interesting to note, that the * 
t 01,02,03,04,05,07,09,11,15,17 3 

pattern resulted in six (6) statistically significant differences 

while the other pattern resulted in only five (5). Though barely 

> f 
different in number, the criterion producing such differences (as 

O.F.) varied in both cases. The reader should recall that signi- 
ficant differences in criterion mean weights portray the ability 
of the model to utilize such criterion constraints within the 
decisioning and solution set building process. 

t 

Reliability Evaluation of the Restricted Model 

Discriminant function analysis was employed to study . the 
consistency and predictability of the model's function in pro- 
ducing reliable solution sets. 

Figure 13 displays the discriminant results for solution set 

I 01,02,03,04,05,07,09,11,15,17 3. 

The major criterion' values predictive of the establ ished .solution 
is shown in the order of their importance. Re-prediction was 
established with 96.77 percent accuracy. 

The results for the solution set 

[ 01,02,04,05,07,11,15,16,17,23 3 & 

are found in Figure 14. In this case, only, three criterion 
distributions were required to re-predict membership at an' 
equivalent 96.77 percent accuracy. 
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Figure 13. Use of Discriminant Analysis in Predicting Program Inclusion for 

Budgetary Revision, Solution #1, Based Upon the Cyclic Optimization 
of the Restricted Problem. 



Budqet 


Incl 


Budget 


Incl 


01 




09 


1 


02 




10 




03 




11 


1 


04 




12 




05 




13 




06 




14 




07 


1 


15 


1 


08 




16 





19 
18 
19 

20 
21 
22 
23 
24 



s 8udget Incl 

/■» 

25 ■ — 

26 — 

28 

/ 29 
/ 30 
/ 31 



Summary of Criterion Value in Discriminating Inclusion Decisions : 
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Figure 14. Use of Oiscrimi nant Analysis in Predicting Program Inclusion 
for Budgetary -Revision, Solution #2, Based Upon the Cyclic 
Optimization of the Restricted Problem. 
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CYCLIC OPTIMIZATION OF THE RELAXED MODEL 



The second of the two major quantitative assessments, the 
relaxed setting produced a wide diversity of.soVution sets. In 
fact, out of twenty executions and seventeen successful 
feasibilities, aTl seventeen solution sets were unique. 

Maximized/Relaxed Solutions 

Figure 15 displays ten unique solutions, one for each of the 
cyclic optimizations under maximization. All solutions were suc- 
cessful in rebudgeting between ,the 675.0 and 700.0 limits. It is 
perhaps more interesting to study the column of numbers labelled 
' selection. tally* , on the right side of the figure. The repeti- 
tion with which particular units were chosen for continued 
funding rese'mbles closely the two solution sets constructed with 
the restricted model formulation. 

Minimized/Relaxed Solutions > 

Minimizing, in the relaxed setting produced three failures at 
set building. Of the seven solution sets constructed, all are 
distinct; and different from the maximization sequence. Figure 
16 presents these data results. 

The alert reader will also note that the relaxed setting - 
produces varying numbers of units within the solution set (Vow. of 
10 to a high of 13 units* sel ected) . . 
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figure 15. Effect Upon Budget Deallocation Decisions Based Upon the Variable flows of a Cyclic Objective function, 
and the Interaction of a "Maximized, Relaxed" Constraint Iterative Problem, if 

Objective ■ Maximization Constraints: Relaxed 
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Ftijjrt lb. Effect Upon Budget Deallocation Decisions Based Upon the Variable Flows of a Cyclic Objective. 
Function, and the interaction of a 'Hlnlmlied, Related* Constraint Iterative Problem. 
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Validity Evaluation of the Relaxed Model 

Figures 17 and 18 contains the analysis of variance results 
cdncerning the mean values for criterion weight membership. As 
might be expected due to the diverse membership of the many 
solution sets formed under relaxation, statistical significance 
is not as controlled and patterned as the restricted modeling 
outcomes. . . 

Reliability Evaluation of the Relaxed Model 

Because of the seventeen different solution sets formed by, 
optimization within 4 the relaxed setting, post .hoc ^assessments "of • 
. consistency were undertaken in a different fashion than those 
under restricted optimal iVy. As Figures 19 and 20 demonstrate 
for maximization and minimization respectively, the frequency of 
a unit's selection as a solution was utilized far, discriminant 
.analysis. Such a choice to utilize frequency obviously increased 
the interval variance of the dependent variable; and it is thus 
expected to diminish the extent of re-predictive^ accuracy. 

Maximization discriminants required five of the .available, 
ten criteria to predict membership at 70.97 percent accuracy. " 
Correspondingly, the minimization discriminants required six cri- 
terion indicators to re-predict at 83.87 accuracy. 

■ ■ '. ' * v . i " : - ■ ■ \. > • 
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Figure 17. 
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t Figure 19. Use of Discriminant Analysis for Predicting the Frequency of •Buo^eTTelect ion 
-. Resulting from a Cyclic Maximization of the Relaxed Problem.' 
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Summary of Criterion Value in Discriminating Selection Frequencies : 
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Classification Results from Predictive Validation : 

Actual . •:. - 

^oup (H) 0 1.. >.; 2 4 
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Percent .of grouped cases currently classified: 70.97' 
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20. ; ( UsVof.'Piscr1minant Analysis for Predicting the FKequenc>: o'f Budget v 
^ • Selection Resulting from a Cyclic Minimization of^.th^; ptdtaxed ,f robi eni; 
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Summary of Criterion Value in Qikrimfriatihg'^sVlection Frequencies :* f.^l, 



STEP , ENTERED >. : 
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1 .Classification-Results fronrPredictive Validation: 
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COMPARISON OF THE RESTRICTED VS. RELAXED ..^'^X. ■-■■<: X 

■ " , . /• DECISION I NG FRAMEWORK " ''* ^.|£f ' 

•s ". '■■>v ; ; 

• • " f ■ • ' ■ • . 

/;Modelirig r wit[i.in the restricted setting produced the most 
, re-prjerfictabl'e l -...and ; criterion-significant, results. Less cri- 
terion measures were required to explain the solution set 
membership. And, restricted optimizations tended to require no 
greater modeling 'effort than the relaxed setti rig.' (measured via 
-iterations and computation seconds), 

Results of the relaxed setting, however, provide a- strong 
preview of the flexibility of the model for determining a wide 
array of solution memberships based upon varying standards 
(objective function values). In addition, the relaxed setting 
"also presents a hint of the diversity in model building? based 
uppn the weighting of particular criterion indicators by relaxing 
certain RHS-values while retaining others in a restrictive 
, f asJfS dh. « y . \ . ' 

■ Finally, both optimality sequences demonstrate the utility 
of the .MAM system in general (and th^rRO^AK system in 
particular) for evaluating multip^le^fifefeia, and selecting- a 
distinct solution set from amo^ftql-ti^ ^'competing alternatives. 

Effect of the Restricted Environment Upon Optimality v * 

i • ■■ ■ 

The restricted environment which constrained the ROLBAK 
decision-making was constructed using an expected solution index. 
(ESI) of value 16; and a perceived expendab'jl i ty v^lue of 500. 
That is, the design of the solution set (program units to be 
funded,- for a total new budget between 675.0 and 700,0 (JOOO's 
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doll ars) ; and reflect] ng&n administr atiy^ percept fdnVdf^pttefti'iy 
•for expendabil ity was .'required to. exhibit the qualities of 
potential; solution with 16 possible; "average 11 member units for 
o each of the £ object expenditure .categories ^deling , the indivi- 
dual programmatic budgets. * Sequehti 'ally, ^ach constraint was 
cycled through the model as the objective function .'(first for 
maximization, then for minimization) in prder to: differentially 
^direct thei-qpnstructtoji of the solution sets under ^ipptimalvjt^y; 
that is , those solution sets which best represented the 
constrained environment design by the restricted, linear" ine- 
quality constraints, and furthermore, provided the most maximal 
(or minimal) summation of the objective function vector. \ 

Optimal ity under maximization . Utilizing restricted 
RHS-value(s) vectors to, construct a feasiblity region for RpLBAK 
decision^\l?;)ing, 2 distinct solution sets were formulated by 
separate sets of _5 of the available K) cyelic objective^ 
functions. Solution #1: 

CI 2 3 4 5 7 9 11 15 17 J 

presented _10 program unit budgets for funding under the reduced 
budgetary levels, out of the existing 31 potential 'multiple 
alternatives^ ' The _5 object expenditure (budgeting) vectors which 
produced; : ';t;h'ese solutions under maximization were: 

' :r-l . .CERT (certificated salaries); 

2. £LAS (classified salaries); 

3. \ SUPL (supplies and materials); 
4 * XffiM (travel expnditures) ; and 

•5. CAPI (capital outlay). 

A total of 213.5 (1000's dollars) was cut from the original 
budget of 893.5 (1000's dollars), deallocating 21 program units, 
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.resulting in a new', system operating level of 680.0 (lOOO's 
dollars). The other distinct solution set constructed under 
maximization, solution #2: 

\V';: [ 1.2 4 5 7 11 15 16 17 23 j 

al^o. presented 10 program unit . budgets for continued funding, out 
of the potential ^31 alternatives available. The remaining £ 
object expenditure vectors which produced these solutions under 
maximization, were: j 

1. BENE (employee benefits); 

2. INST ( instructi onaT^materi al s) ; 

3. CONT (contractual services): 

4. PERC (administrative perception); and 

5. COMP (budgetary composites). 

■ / 

A total 'of 213.0 (lOOO's do-llars) was cut from the original 
budget of 893.5 (lOOO's dollars), /deallocating 21 program units, 4 * 
resulting in a new, system operating level of 680.5 (lOOO's 
dollars).. Thus the difference between the" two solution sets was 
approximately^ (lOOO's dollars) and 4 varying unit member 
^slips. - . - m 

Optimal ity under minimization . Utilizing restricted '■ 
RHS-value(s) vectors to construct the feasibil ity region for 
ROLBAK decision-making, the same 2 distinct solution set were . 
found under minimization, as were developed under! maximization. 
Differences were observed however, both in the number of 
occurrences of thesolution set, and in the objepxive function(s) 
which guided the solutionaV design. Solution #3 

C 1 2 3 4 5 7 9 11 15 17 J 
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resulted from the following £ objective* function vectors: 

/ 

1. BENE (employee benefits); 

2. ' INST (instructional materials); 

3. CONT (contractual services); and 

4. *PERC (administrative perception). 

The reader will note, that under maximization, these same four 
vectors collaborated on a different solution set. The resulting 
expenditure reduction of 213.5 (1000's dollars) remains the same, 
of course. Solution #2, under minimization: 

I 1 2 4 5 .7 11 15 16 17 . 23,3 

occurred 'in S - instances; under the use of the cyclic objective 
functions: 

1. CLAS (classified salaries); 

2. SUPL (supplies antl materials); and 
3.. CAPI (capitaloutlay). 

The reader will also note, that previously under rpaximization, 
these same three vectors coll aboratfed on., a different ^solution 
set. As before, the resulting expenditure reduction of 213;0 
(1000's dollars) remains the same. 

Validity analysis of restricted results . For the purposes 
of this study, validity tests represented the administration of 
post hoc analysis to determine if the resulting solutions y 
reflected the. original objectives of the ROLBAK model. The ori- 
ginal ROLBAK objectives ; were formulated via the construction- of 
the linear 'object category 1 vectors. Validation under these 
circumstances proceeds in two stages. Stage 1 validation is 
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moot, since the executed ROLBAK model produced at least one solu- 
tion vector (in our case, two distinct alternative solution 
sets), in conformance with pre-defined RHS-vector/values. Stage 
2 validation proceeds to analyze the values of the various 
constraint vectors; and to test their mean-differences determined 
by their solution versus the non-solution membership. 
Parametric, oneway analysis of variance procedures were utilized 
to test these criterion, mean-value differences. Solution #1: 

CI 2 3 4 5 7 9 11 15 17 3 

demonstrated £ of the 10 criterion vectors to produce statisti- 
cally significant (p ^ .10) greater criterion mean-weights for 
the solution sets,'. then existi ng within the non-solution set. 
The six criterion vectors were: 



"l : r CERT (certificated salaries); 

2. CLAS (classified salaries); - .; «? 

3. SUPL (supplies and materials); . V ; *^ ^ 
.4. INST ( instruct iona^n^Pferi al s) 

5. CAPI (capital ^oujtla^); and ! ' ■ ' "... 

6. GOMP ( budget ary>composi tes) . 



Of the remaining 4 vectors, employee benefits (BENE), contractual 
services (CONT), and travel expenditures (TRAV), the lack of p < 
.10 significance is not viewed as an indication of potential 
invalidity, due to the mean-trends observed. The relatively con- 
founded p-level for administrative perception (PERC) of p = .67, 
is understandable based upon the ordinal scaling for PERC, in 
which each ordinal graduation (1, 2, 3, 31) is represented. 
Similarly, solution #2 is: 7 

i 1 2 4 5'7 11 15 16 17 23 3 
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demonstrated 5 of the 10 criterion vectors to produce statisti- 
cally-significant (p jc .10) greater criterion mean-weights for 
the solution set. These five criterion vectors were: 

1. . SUPL (supplies and materials); 

2. INST (instructional materials); 

3. CONT (contractual services); 

4. CAPI (capital putlay); and 

5. COMP (budgetary composites). 

The remaining five criterion mean weights are acceptable,, though 
not at the desired p < .10 level. Much of the inability to gain 
the desirable p < .10 level can be attributed to the iarge pro- 
portion of zero-cells (scant index) within the constraint matrix. 

Reliability analysis of restricted results . For the pur- 
poses of this study, reliability tests represented the admin- 
istration of post hoc analyses to determine if the resulting 
solutions were 'predictable 1 based upon the multiple- data distri- 
bution configurations of the criterion vectors; that is, whether 
a particular program unit's inclusion (versus exclusion) within 
the solution set was predictable. Parametric discriminant func- 
tion analysis procedures were utilized to evaluate the extent of 
such predictability. In order to predict the original solution 
set #1: 

[ 1 2 3 4 5 7 9 11 15 17 3 

a total of 5^ criterion distributions were required, listed in. 

the order of their importance (i.e., amount of variance explained 

and order of entry into discriminant construction), these cri- 
teria are: 



128 



142 



V 



ERIC 



;V,f . ' 1- COMP (budgetary, composites); , 

2. SUPL (supplies and materials); 

3. CAP I (capital outlay); ^ 

4; CERT (certificated salaries); and 

5. CLAS (classified salaries). 

/ ■ . 

The discriminant re-prediction (reclassification of solution set 
membership), resulted in I mis-inclusion for a final 96.77 percent 
accuracy (repredicability) factor. In turn, solution #2: 

C 1 2 4 5 7 11 15 16 17 23 j - 

required the, fol lowing 3 criterion distributions in order to pre- 
dict members solution set (in order of 

; •impp^ ; -'\ . ' 

' ■ ' 1. COMP (bud^ietiry. composites); *' 

2. CONT (contractual services); and 

3. INST, (instructional Materials). 



The discriminant rfe^i^pcfict ion for* the second solution formed 
upon restricted Op^^byality resulted in 1 mis-exclusion for a 
final 96.77 percent accuracy factor. The reader will note, that 
the criterion<c!^ COMP was the only vector utilized in 

both d i s cr;iini t prtnu 1 i z at i o n s . 

Uoij^fo^ Whi 1 e maximization (optimality) pro- 



duced a Sopt^^ cyclic^ iteration of the various 

criterlpjtf^ was unable to produce a solution 

vector, ;^£n:.^ being •minimized 1 were the 3 

vectors :*v " 



1 &ttfj C)ceriTf'Tca!t ed sal ari es ) ; 
2^/'^^MVv^^aVe1"fi)^ehditures) ; and 



■l-.l 'V 
#;VY»V.:'"« i '•-•,tV . 



Non-solutions based, upon TRAV can be discounted based upon tha 
high proportion of zero-cell entries (29 of 31, possible cells 
equal to 0);' in which cas.e, the model could not 'make up its 
mind 1 . Non-optimal ity under the guidance of CERT and/or COMP 
however, is an interesting result. Precisely stated (and hope- 
fully-in English), neither tha;CERT nor the COMP vector (s) could 
summate to a small enough final value (minimum), such that the 
optimal objective function vector could physically pass-through 
the feasibility region geometrically constructed via the 11 
constraint matrix inequalities. (The authors apologize for the 
last statement! ) / . 




Effect of the Relaxed Environment Upon Optimal ity/ 

The rel axed environment which constrained the ROLBAK 
decision-making was constructed Using an expected solution index 
(ESI) of value _10; and a perceived expendat^ility value of 600. 
That is, the design. of the solution set was ^required to exhibit 
the qualities of potential solution with 10 possible "average" 
member units for each of the 8 object categories used in 
constraints. The reader will note, that since the RHS-value for 
administrative perception '(PERC) was increased to value 600 , 
program units with greater 'perceived expandability 1 levels could 
still become members of the solution set -- that a is, refunded for 
continuation. As with the restricted" environment discussed fn 
the preceding section, each constraint was cycled through the 
relaxed model (sequentially) as the objective function. 

• Optimal ity under maximfzation . ROLBAK produced' a distinct 
solution set for each of the ^10 cyclical objective functions uti- 
lized during optimal maximization of the relaxed model. In fact, 
only the program units: 
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Programmatic savings ranged from a low of 202.0 (1000's dollars) 
based upon TRAV: > 

■ t \ 4 5 6 7 11 15 16 17 21 ' 26 J 

■■ ' ■ 

to a high of 218.5 (1000's dollars) based upon CONT: 

C 1 2 3 4 6 7 9 15 17 18 23 26 i . 

Unit membership ranged from a high of 13 (INST) to a low of 10 
(PERC). Not one of 1_ solutions under minimization was identical 
to the 10 solutions under maximization.' 

Validity analysis of relaxed results . The approach to vali- 
dating the results of th ROLBAK execution under relaxed condi- 
tions differed from that previously discussed within the 
restricted state. Since 17 distinct' solution sets were formed 
based upon both maximization and minimization under relaxed 
conditions, validation of the effect, of solution set construction 
upon individual criterion mean-weight differences was effected in 
two related ways. First , the frequency of p < .10 occurrences, 
where each defined objective function (CERT, CIAS, COMP) 
produced desirable mean-value weights across \\e criterion 
constraints was explored, utilizing (as before) oneway analysis 
of variance procedures. These results are indicated as: 

I N R (p < .10) j. s "... 

secondly, the frequence of p < .10 occurrences, where criterion 
constraint values (CERT, CLAS, COMP) reflect desirable 
mean-value weights across the cyclic objective functions, were 
studied; and indicated as: 
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t N c (p t .10) a. y 

Figure 21 summarizes 'these N R and. N G * «ummat#Vis for optimal ity 
results under both maximization and minimization. The 
N R -frequencies are analogous to those previously defined for the 
restricted environment. Based upon the computed percents for the 
total frequencies possibly, 10 and 2 (for maximization and 
minimization, respectively), the N R values appear relatively 
identical; Iffkewi^e for the N c frequencies/humming both the 1 
N R and Nq values, and ranking those sums (where 1 = high and 10 = 
low), an ordinal measure of relative weight can be developed. 
Finding the absolute value of the difference between these sum 
(N R ) and (N c ) ranks (i.e. j DIFFrRANKS | ), presents a measure of 
relative consistency between and N c values. The authors have 
previously thought that the greater the consistency, the greater 
the resulting value of the particular criterion vector. " Thus, 
the "smaller the rank-difference, the more valuable the criterion 
involved. However, ^careful examination of the ranks of N^and t .s 
Nq demonstrate|fchat the correlation between the two vectors of 
rank to be non-parallel (correlation '(N R , Nq) = -0.666). And 
furthermore, that the correlation between the N R and Nq values, " 
and their difference (DIFF-RANKS) to be nearly non-existent 
(+0.129 and -0.048, respectively). Further study is required in 
this area to study these issues of consistency! and utility. 

Reliability analysis of relaxed results . As with restricted 
results, discriminant functions were utilized to 'determine the 
predictabl i ty of the obtained solution. vectors. For the relaxed 
environment however, membership in any particul ar 'solution set 
'was not the dependent variable; rather, the frequency of each ;.- 

individual program unit being chosen for refunding across all 

,/ ■ , ^ . '■•„,. '-> 

criteriorv objective, function^ (i.e. the selection tally for, the 

tracking matrix) was used as the dependent (to be predicted") 
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; -.V.';' ; ;..i' 'Figure 21. 



Summary of [ N R (p < .10) ] and [ N r (p < .10) ] Values from 
Figures 19 and K 20. . < L " 



where: 
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CERT 


CLAS' 


BENE 


SUPL 


INST; 


CONT 


TRAV 


CAP I 


PERC COMP 


Maximization 








«r 


; ;.r 


• * 




4 




t N R (p < .10) ] 


5 


4 


7 






4 


5 . 


. 3 


5 • 4 . 


PCT. (T0T=10) 


50.0 


40.0 


70.0 : 


50.0. 


*60.0 : 


40.0 


50.0. 

f 


30.0 


50.0 40.0 


t N c (j};< .10) ] 


4 


3 


2 


. 7 


7 


1 


2 


10 


t 1U 


- PCT (T0T=10) 


40 .0 > 


30 .0 ' 

► '/ , 


*?0.0 


70.0 


70.0 / 


10.0 *^0 % 0\ 


100.0 


100.0 


Minimization 


•v.- ' 


















[ « ft (p < .10) ] 


*>** 


"* .3""r 


5 


4 


5 




•V ' 




5 s — 


. PCT (T0T=7) : \ 
i « c (p < .10) ] 


42.9 
4 


2 


71.5 


57.2 
6 


71.5 

5 

T 


85.8~ , 


71.5- 
1 


7 


*V ' 7 


PCT (T0T=7) 


57.2 


28.6 




85.8 






14.3 


100.0 


14.3 100.0 


Sum (N R ) 


- 8 


4 


12 


9 


n 


10 


10 


3 


10 / 4 


t RANK ] 


C7-0] 

\ 


.C8.5] 


[1.0] 


[6.0] 


C2.0] 


[4.0] 


[4.0] 


[10,0] 


[4.0] [8.5] 


Sum (N c ) 


8 ~ 


t> . 


2 


13 \ 


12 


1 


3 


17 


3 17 


t RANK ] 


[5-0] 


t6.0] 


[9:oj 


P-0] 


[4.0] 


£10.0] 


[7.5] 


[1.5] 


[7.5] [1.5] 


[ U IFF -RANKS | 


2.0 


2.5 


8.0 


3.0 


2.0 


6.0 


3.5 




3.5 7.0 



[ h r(p i -10) ] 8 N of p < occurrences where each defined objective function (CERT, 
CLAS, COMP) produced tffrvireable mean-value weights across the 
criterion constraints. 

[ N c (p < .10) ] a N of p < .10 occurrences, where criterion constraint values (CERT, 

CLAS COMP) reflect desireable moan-value weights - 

across the cyclic objective functions. 




"variable. Under maxiniijatTdn re-prediction ; of fihe ; selection 
\fr6quency (ke. %hi N of Inclusion .across 10 succeswruJ ... 
•executions) -required 5 criterion distributions td ^ formulate 
discriminant functions*. In order of entry and import artce.,/t hey f. 



were: 




1. COMP (budgetary composites); 1 '-- . .;. . '.> ; 

2. . INST, (.instructional materials); \ : , 
3- CAPI (capital outlay); . . . 

PERC (administration perception); and;, 
5, CLAS (classified salaries). 

The,dr^^ (recTaVstf.ication of .total inclu- 

s i orr frequency ).;.r u 1 ted in A over-estimates' ^nd'lj uiiider-' — 
estimates f dr a f Trial ;7Pv97 percent accuracy ( r epr e d i ct ab f ' 
factor/ Minimization results, on. the other hand required ^';cf • 
terion distributions to formulate the discriminant functions' 

1. COMP. (budgetary composites); 

2. BENE (employee Wn^f its); . ? 

3. CONT (contractual services); p., . 

4. TRAV (travel expenditures)^^ " 

5. CAPI (capital outlay).;; arid 

6. SUPL\(suplies and jnateri al s) . .* 

V- : ■i'fjr ■ " . 

■ ' '' >&''''' r ' i7 < ^ 

Discriminant re-prediction yielded _3 over-estimates and 2 under- 
estimates for a total accuracy factor of 83.87 percent. It woukl 
seem, that the criterion distributions are much more useful in * 
predicting individual inclusion, then in determining total inclu- 
sion across all criterion objective functions. 

Non-solution results . 'As was evidenced in the restricted 
environment results, only minimization within a relaxed region 
produced instances (2) of non-solution; they were: • 



1. ■ OLftS-; '(cTassified salaries); 

2. ■ CAPJv (fcapi t&l out! ay) ; ' and 

3. COMP (budgetary composites), 
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PART IV 



FUTURE; OF' ROLBAK MODELING AND 
• RELATED MAM FRAMEWORKS : 
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SUMMARY OF THE • "MAM" FRAMEWORK AND "ROLBAK" 



.This study, has sought to demonstrate the util.ity of the ' 
multiple alternative modeling formul atiojp (MAM^ in determining 
program units for continued funding during a fiscal crisis. 
Based. uppn ajv acceptance of criterion-referenced model for simu £ * 
lating future, probable decisionirig alternatives,^ the^MAM fiscal * ' 
mod^l ,- ROLBAK , evaluated various form* of data undp.r different* 
system go^l^^ons^ upon. \ * 

decisionmaking;, that is,;which program 'units to cbntinue, and 4 c *> + 
which to "deallocate. Like, the school closure and "curriculum ■- * * . 
^et-i^rty^^ s preceding thi srfi:srcil^ rol T-back ; : v 

model will assist progr|j^administrators as they seek to' continue 1 
program' operation at an^timal level, thotigh in>a.state of 
reduced funding. v " r • ir ■ y 



The. Mu 1 1 i pi e-Al tern at i ves Formu 1 i z ati on 

* .■■ 
, The multiple-alternatives model (MAM) has been deyised for 
the situations irt which multiple solutions, are required. School 
closures require more than one site be selected to remediate 
existing* declining enrollment impacts and wastage of low pe£- 
capita expenditures. Curriculum activity'packaging requires the 
iJest^o^siin'O a*ctTvIties to match desired" 

outcomes. And, funding crises require some select number of 
programs-be designated for discontinuance. 



The MAM concept models 'these evaluation complexes through 
the use of systems of linear inequal i tips *and equalities Each . 
inequality (or equality) represents a specific objective pre- 
defined by the decision-maker'; criterion referenced andtabeledla 
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constraint (to final solution selection). The system of ine- 
qualities and equalities relate etth constraint objective to each 
of^ the 'decision alternatives being modeled (evaluated for poten- 
tial Inplusrioif with "the final solution set). In addition, some 
one* or* several criterion vectors is (are) selected to act as the 
°veraTl,gtIide , 'to decisional optimal.ity, as the objective 
^function. .„ ' ■;■ 



--The^fcflA^ Mode I 



. The l#LBAK mddeling structure studied within tfhi.s^ paper, 
presents, a -MAM- ad a pt at ion to as sist decisiQn-mak.&rs_-when-pcnc|cam- 
are'as must be 'cut'(i»e. deallocated) due to reduced funding. 
kOLBAk exists as a sane arid rational alternative to the usual 
percentage-cut across-the-board; and allows the administrator to 
systematical ly criterion-reference such complex decisions.. 

Criterion-referenced constraints have been .shown to poten 7 
tially indl.'ude budgets by object classification, surveyed percep- 
tion of affected-participants, and total budgetary composite 
control . (In' addition,, the. utility of varying criterion, control 
(objective function)- has- been 'illustrated!' 




Conip4.ex^j^roa<^sH:-{^-eomp^ — — ■ «~ — 

,Ihe.-.authors. maintain that issues involving many potential 

solutions are indeed tod complex for the human mind 'to 



comprehend. Mam-effects and interactive-effects' model ing simu- 
lations provide a valid and re.lfable methodology for evaluating 
the MAM environment.- Without sucji formulations, complex * ' 
decision-making is .little more than 1-part "experience" and 
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4-parts "blind luck 11 ( and often with less than successful 
results). 

, But the main areas of criticism will still prevail. First, 
that the need to quantify the criteria requires a greater com- 
mittment to criterion-referencing than many decision-makers 
possess. Secondly, that high degrees of time, effort and 
sophistication are required of individuals who possess little of 
the above. And finally, "that the system requires optimally a 
■computer; and human-based solutions should 'never 1 (?) be based 
upon computer analysis. 

H\s social scientists- and 'humarrsT~simuTtaneous1y^we 1 

acknowledge these misgivings for what they are; and disagree ami- 
cably (sometimes). t - ^ 

The Future of MAM Design 

The matching of micro-computerized hardware and software to 
desired instructional objectives; the evaluation of item analysis 
-techniques for designing computer-assisted survey techniques; and 
the consolidation of school districts — are a relatively small 
but representative sampling of areas where this author is 
currently developing future MAM applications. Wherever a poten- 
tial for multiple solutions exists, the multiple alternatives 
model will be there, -Multiple alternatives modeling is. not the 
wave of the future — it is the available tool of tpday . Do 
it! !,! 
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